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FOREWORD 


This  analysis  was  conducted  by  the  Test  Design  and  Analysis  Branch  of 
the  Combat  Operations  Analysis  Directorate,  US  Army  Combined  Arms  Combat 
Developments  Activity,  In  support  of  the  US  Army  Combined  Arms  Training 
Development  Activity  directed  Training  Instrumentation  Evaluation  (TIE). 
Authority  for  this  experiment  and  analysis  Is  contained  In  the  Outline 
Test  Plan,  Training  Instrumentation  Evaluation  (TIE)  Test,  FC  095,  28 
March  1978.  This  technical  paper  was  completed  in  October  1979. 

The  authors  wish  to  express  their  appreciation  to  Miss  Sue  Wright  and 
Mr.  Jack  Low  for  developing  graphic  portrayals  of  the  TIE  trials  at  the 
Combat  Operations  Analysis  Directorate's  Central  Graphics  Facility. 

Without  their  Involvement  several  of  the  reported  Insights  would  have  been 
overlooked. 


ABSTRACT 


The  Training  Instrumentation  Evaluation  (TIE)  was  a  tank  heavy  company 
team  field  test  designed  to  provide  baseline  Information  on  training  via 
tactical  engagement  simulation  In  an  Instrumented  environment.  The  test 
results  are  being  used  as  an  aid  In  the  planning  of  a  National  Training 
Center  (NTC)  for  armor  and  mechanized  Infantry  battalions.  The  United 
States  Army  Combat  Developments  Experimentation  Command  (CDEC)  conducted 
the  test  and  authored  the  test  report. 

This  paper  describes  the  data  reduct Ion/ an a lysis  performed  on  the  TIE 
test  data  by  the  Directorate  of  Combat  Operations  Analysis,  US  Army 
Combined  Arms  Combat  Development  Activity.  This  analysis  was  limited  to 
providing  Insights  Into  changes  In  unit  tactical  proficiency  that  occurred 
when  Instrumented  tactical  engagement  simulation  was  used  for  training  and 
to  verifying  provisional  measures  of  effectiveness.  The  data  analysis 
results  were  provided  as  Input  to  the  TRADOC/FORSCOM  NTC  development 
effort. 


EXECUTIVE  SUMMARY 


1.  BACKGROUND. 

a.  The  United  States  Army  Training  and  Doctrine  Command  (TRADOC)  and 
the  United  States  Army  Forces  Command  (FORSCOM)  Headquarters  are  working 
to  develop  a  National  Training  Center  (NTC),  which  will  train  armor  and 
mechanized  Infantry  battalions.  This  concept  calls  for  battalions  to 
rotate  through  the  NTC  for  approximately  2  weeks  of  Intensive  combined 
arms  training.  The  units  will  participate  in  both  live  fire  and 
engagement  simulation  exercises  against  a  realistic  threat  force  using 
tactical  air,  artillery,  and  electronic  warfare.  The  NTC  will  be  designed 
to  provide  training  exceeding  the  scope  possible  at  a  unit's  home  station. 

b.  A  basic  premise  of  the  NTC  concept  asserts  that  a  unit  learns  not 
only  from  participating  in  live  fire  and  engagement  simulation  exercises 
but  also  from  After  Action  Reviews  (AARs)  that  follow  the  training 
exercises.  This  premise  further  states  that  the  AARs  can  be  most 
effective  when  they  are  based  on  detailed  data  collected  during  the 
conduct  of  the  training  exercises. 

c.  In  September  1977,  TRADOC  Headquarters  expressed  a  desire  to 
collect  data  during  the  Tanks  and  Mechanized  Infantry  (TAMI)  experiment  to 
assist  in  the  development  of  the  NTC.  When  TAMI  was  cancelled,  the  effort 
shifted  to  developing  a  separate  test  to  support  the  NTC.  This  test  was 
scheduled  at  Fort  Hunter  Liggett,  California  for  January  and  February  of 
1978.  Heavy  rainfall  in  January  and  February  along  with  conflicting 
FORSCOM  coiinltments  caused  the  test  to  be  delayed  until  July- September 
1978. 

d.  TRADOC  designated  the  Combined  Arms  Training  Development  Activity 
(CATRADA)  as  the  test  proponent.  The  basic  concepts  of  the  project 
analysis  were  developed  at  a  2-day  planning  conference  held  16-17  November 
1977  with  representatives  from  TRADOC,  CATRADA,  the  Army  Training  Study 
(ARTS),  the  Army  Research  Institute  for  Behavioral  and  Social  Sciences 
(ARI),  and  the  Army  Combat  Developments  Experimentation  Command  (CDEC). 
Conferees  agreed  that  the  Training  Instrumentation  Evaluation  (TIE)  test 
would  be  conducted  within  the  following  context. 

(1)  It  would  be  the  first  of  a  series  of  tests  designed  to 
quantify  the  Increase  In  tactical  proficiency  that  could  be  achieved  by 
providing  detailed  objective  feedback  to  units  participating  in  two-sided. 
Instrumented  engagement  simulation  exercises.  This  company  level  test 
would  focus  on  the  Incremental  benefits  of  training  at  an  NTC  after  the 
test  units  had  completed  a  Multiple  Integrated  Laser  Engagement  System 
(MILES)  type  of  training  at  home  station.  As  the  Initial  test,  TIE  would 
attempt  to  identify  general  trends  and  develop  techniques  and  methodology 
for  subsequent  tests. 
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(2)  The  experience  gained  during  this  test  would  be  used  to 
facilitate  the  progressive  development  of  quantifiable  measures  of  unit 
effectiveness.  It  would  also  provide  Insights  Into  the  control  structure 
necessary  to  conduct  Instrumented  training  exercises  at  the  NTC. 

(3)  The  data  collection  effort  would  focus  on  the  time  and 
position  location  of  significant  tactical  events,  the  recording  of  voice 
transmissions  (VRS)  on  the  company  command  net,  video  recordings  of 
significant  events,  and  any  data  that  might  be  used  to  provide  subjective 
support  for  the  After  Action  Reviews  (AARs). 

2.  PURPOSE.  The  purpose  of  the  TIE  test  was  to  provide  data  at  the 
company/team  level  which  could  be  used  to  assist  In  the  development  and 
evaluation  of  tactical  engagement  simulation  training  with  Instrumented 
feedback  as  part  of  the  concept  for  a  National  Training  Center. 

3.  OBJECTIVES. 

a.  TIE  objectives  addressed  In  this  report  are  as  follows: 

(1)  Objective  1.  Provide  insights  into  changes  in  the  level  of 
unit  tactical  proficiency  that  occur  when  Instrumented  tactical  engagement 
simulation  Is  used  for  training. 

(2)  Objective  2.  Verify  or  revise  provisional  measures  of 
effectiveness  (MOE). 

b.  The  following  additional  objectives  are  addressed  In  USACDEC 
report.  Training  Instrumentation  Evaluation  (TIE)  Final  Report  dated 
December  1978. 

(1)  Objective  3.  Sain  Insights  Into  the  nature  and  extent  of 
Information  required  to  provide  the  feedback  and  diagnostic  information 
required  to  Improve  tactical  proficiency. 

(2)  Objective  4.  Provide  information  to  assist  in  the 
development  of  a  MILES  control  system  and  ultimately  that  for  a  National 
Training  Center. 

4.  SCOPE. 

a.  TIE  was  a  two  sided  force-on-force  Instrumented  training  exercise 
that  matched  a  US  tank  heavy  company  team  In  a  movement  to  contact/hasty 
attack  scenario  against  a  reinforced  motorized  rifle  platoon  In  a  hasty 
defense.  The  opposing  force  was  structured  to  provide  a  Red  to  Blue  force 
ratio  of  1:3.  It  provided  for  Integration  of  ATSMs  (l.e.,  TOW  ,  DRAGON 
and  SAGGER);  the  primary  weapon  system  on  the  M113  (50  Cal  MG);  the 


primary  and  secondary  weapons  on  M60  tanks  (105mm  and  7.62nm  coax  MG, 
respectively);  and  the  73mm  antitank  gun  (SPG-9).  Appropriate  US  weapon 
systems  were  used  as  surrogates  to  represent  the  threat  weapons.  Infantry 
small  arms  (M16A1)  were  Instrumented  in  a  "stand  alone"  mode  (l.e.,  not 
Interfaced  with  main  computer  system).  Indirect  artillery  fires  could  be 
requested  by  the  players,  and  casualty  assessments  were  made  via  the 
Indirect  Fire  Casualty  Assessment  and  Suppression  (IFCAS)  system. 

Although  ammunition  depletion  was  portrayed  during  TIE,  there  was  no  means 
of  portraying  logistics  or  resupply  requirements. 

b.  All  trials  were  conducted  in  the  Gabilan  Valley  at  Fort  Hunter 
Ligget,  CA.  To  minimize  the  effects  of  terrain  familiarity,  specific 
trial  sites  were  varied. 

c.  The  experiment  was  conducted  with  two  US  force  player  sets  and  one 
threat  force.  Player  set  1  executed  14  trials  over  a  2-week  period  of 
time.  Player  set  2  executed  8  trials  over  a  2-week  period  against  the 
same  threat  force. 

d.  The  test  design  of  TIE  was  atypical;  that  is,  the  TIE  test  was  not 
structured  as  an  ordered  number  of  design  cells,  defined  by  specific 
Independent  variables,  containing  a  specific  number  of  trials,  and 
intended  to  be  compared  statistically  against  one  or  more  of  the  other 
cells.  Instead,  the  test  consisted  of  two  sequences  of  trials  performed 
by  separate  player  groups.  Fourteen  trials  were  executed  by  player  group 
1  and  comprised  the  first  sequence;  8  trials  were  conducted  by  player 
group  2  and  comprised  the  second  sequence.  Each  sequence  was  considered 
as  an  ordered  series  of  learning  experiences  during  which  the  player  set 
was  expected  to  improve  its  tactical  proficiency.  Each  sequence  was  used 
to  roughly  plot  the  learning  effect  for  that  unit  over  that  particular 
player  set  and  the  order  of  learning  experiences.  In  order  to  establish  a 
rough  estimate  of  the  relative  proficiency  of  the  two  units,  selected 
trials  were  conducted  under  identical  conditions  with  no  player  feedback. 
For  consistency,  the  same  defensive  player  set  was  used  to  oppose  the  two 
offensive  player  sets.  Numerous  trial  sites  were  used,  and  within  each 
trial  sequence  the  defensive  posture  was  not  duplicated  on  the  same  site. 

5.  ANALYSIS  RESULTS. 

a.  The  TIE  analysis  Indicated  that  the  level  of  tactical  proficiency 
for  player  group  2  increased  during  a  series  of  instrumented  engagement 
simulation  exercises.  The  observation  that  this  trend  was  not  apparent 
for  player  group  1  can  be  attributed  to  some  unforeseen  fluctuations  In 
the  group  1  situation.  For  example,  the  effective  force  ratio  was  varied 
in  the  early  trials  due  to  Instrumentation  difficulties  while  at  the  same 
time  a  major  modification  in  defensive  tactics  was  occurring.  Further 
analysis  of  TIE  data  Indicated  player  group  1  Improved  in  specific 
functional  areas  during  their  sequence  of  Instrumented  engagement 
simulation  training  exercises. 
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b.  Quantitative  measures  of  effectiveness  that  were  most  indicative 
of  tactical  proficiency  were: 

o  Total  number  of  threat  antitank  weapon  systems  killed 

o  Total  number  of  threat  antitank  weapon  systems  killed  or 
surviving  with  anmunltlon  depleted 

o  Relative  survivability 

o  Percent  of  OPFOR  weapons  paired  by  US  forces 

o  Effective  (US/OPFOR)  force  ratio  (includes  only  those  weapon 
systems  that  effectively  paired  enemy  elements) 

o  Percent  of  US  AT  firings  resulting  in  pairings 

o  OPFOR  weapon  casualties  per  US  AT  round  fired 

o  AT  weapon  effective  exchange  ratio  (EER) 

o  Casualty  exchange  ratio  (CER) 

c.  Quantitative  measures  of  effectiveness  that  were  most  indicative 
of  learning  occurring  in  one  or  more  functional  areas  during  the  trial 
sequence  were: 

o  Number  of  threat  AT  weapon  systems  killed 
o  Number  of  threat  weapons  not  paired  by  US  weapons 
o  Mean  number  of  US  weapons  pairing  each  threat  element 
o  Number  of  M60s  and  TOWs  pairing  at  least  once 
o  Percent  of  Blue  AT  firings  resulting  in  effective  pairing 
o  Blue/Red  effective  pairings 
o  Percent  of  threat  targets  effectively  paired 
o  Percent  of  Blue  force  effectively  employed 
o  Effective  (Blue/Red)  force  ratio  (EFR) 

6.  SUMMARY/CONCLUSIONS. 

a.  The  available  data  indicated  that  there  was  a  considerable  degree 
of  variance  among  the  evaluators'  ratings  of  tactical  proficiency. 


Included  among  the  factors  possibly  contributing  to  this  variance  are: 

(1)  The  evaluators  had  varying  degrees  of  background  and 
experience  (e.g.,  company  grade  and  field  grade  officers,  different  levels 
of  military  schooling  (basic,  advanced  courses,  CGSC),  etc.). 

(2)  The  evaluators  observed  the  trials  from  different  vantage 
points  (OPs,  helicopters,  positions  in  the  battle  area,  etc.). 

b.  The  averages  of  the  evaluators'  ratings  from  the  Test  Directorate 
Opinion  Questionnaires  (TDOQ)  were  shown  to  be  consistent  to  the  averages 
of  the  evaluators'  ratings  from  the  Controller  Daily  Performance  Records 
(CDPR)  both  in  overall  proficiency  and  across  most  functional  areas.  This 
supports  the  validity  of  using  the  proficiency  rankings  in  analyzing  the 
MOEs.  It  is  also  indicative  that  the  individual  evaluator  observations, 
used  to  determine  the  ratings,  were  consistent  with  task  analyses  derived 
from  the  ARTEP. 

c.  The  TIE  analysis  indicates  that  the  level  of  tactical  proficiency 
for  player  group  2  increased  during  a  series  of  instrumented  engagement 
simulation  training  exercises.  The  observation  that  this  trend  was  not 
apparent  for  player  group  1  can  be  attributed  to  several  confounding 
effects. 

d.  The  learning  accomplished  during  a  sequence  of  force-on-force 
instrumented  exercises  Is  greatly  obscured  by  the  trial -to- trial  variance 
inherent  in  such  exercises. 

e.  The  large  number  of  unpaired  firings  during  force-on-force 
instrumented  exercises  poses  a  significant  problem  in  measuring  mean 
assessment/kill  ranges. 

f.  The  engagement  simulation  force-on-force  training  environment 
provides  quantifiable  MOE  related  to  areas  of  tactical  operations  that 
have  heretofore  been  evaluated  subjectively. 
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1.  INTRODUCTION, 
a.  general . 


(1)  The  United  States  Army  Training  and  Doctrine  Comnand  (TRADOC) 
and  the  United  States  Army  Forces  Command  (FORSCOM)  Headquarters  are 
working  to  develop  a  National  Training  Center  (NTC),  which  will  train 
armor  and  mechanized  Infantry  battalions.  This  concept  calls  for 
battalions  to  rotate  through  the  NTC  for  approximately  2  weeks  of 
Intensive  combined  arms  training.  The  units  will  participate  in  both  live 
fire  and  engagement  simulation  exercises  against  a  realistic  threat  force 
using  tactical  air,  artillery,  and  electronic  warfare.  The  NTC  will  be 
designed  to  provide  training  exceeding  the  scope  possible  at  a  unit's  home 
station. 


(2)  A  basic  premise  of  the  NTC  concept  asserts  that  a  unit  learns 
not  only  from  participating  In  live  fire  and  engagement  simulation 
exercises  but  also  from  After  Action  Reviews  (AARs)  that  follow  the 
training  exercises.  This  premise  further  states  that  the  AARs  can  be  most 
effective  when  they  are  based  on  detailed  data  collected  during  the 
training  exercises. 

b.  Background. 

(1)  In  September  1977,  TRADOC  Headquarters  expressed  a  desire  to 
collect  data  during  the  Tanks  and  Mechanized  Infantry  (TAMI)  experiment  to 
assist  in  the  development  of  the  NTC.  When  TAMI  was  cancelled,  the  effort 
shifted  to  developing  a  separate  test  to  support  the  NTC.  This  test  was 
scheduled  at  Fort  Hunter  Liggett,  California  for  January  and  February  of 
1978.  Heavy  rainfall  in  January  and  February  along  with  conflicting 
FORSCOM  commitments  caused  the  test  to  be  delayed  until  July  through 
September  of  1978. 

(2)  TRADOC  designated  the  Combined  Arms  Training  Development 
Activity  (CATRADA)  as  the  test  proponent.  The  basic  concepts  of  the 
project  analysis  were  developed  at  a  2-day  planning  conference  held  16-17 
November  1977  with  representatives  from  TRADOC,  CATRADA,  the  Army  Training 
Study  (ARTS),  the  Army  Research  Institute  for  Behavioral  and  Social 
Sciences  (ARI),  and  the  Army  Combat  Developments  Experimentation  Command 
(CDEC).  Conferees  agreed  that  the  Training  Instrumentation  Evaluation 
(TIE)  test  would  be  conducted  within  the  following  context. 

(a)  It  would  be  the  first  of  a  series  of  tests  designed  to 
quantify  the  Increase  In  tactical  proficiency  that  could  be  achieved  by 
providing  detailed  objective  feedback  to  units  participating  In  two-sided. 
Instrumented  engagement  simulation  exercises.  This  company  level  test 
would  focus  on  the  Incremental  benefits  of  training  at  an  NTC  after  the 
test  units  had  completed  a  Multiple  Integrated  Laser  Engagement  System 
(MILES)  type  of  training  at  home  station.  As  the  Initial  test,  TIE  would 


attempt  to  Identify  general  trends  and  develop  techniques  and  methodology 
for  subsequent  tests. 


(b)  The  experience  gained  during  this  test  would  be  used  to 
facilitate  the  progressive  development  of  quantifiable  measures  of  unit 
effectiveness.  It  would  also  provide  Insights  Into  the  control  structure 
necessary  to  conduct  Instrumented  training  exercises  at  the  NTC. 

(c)  The  data  collection  effort  would  focus  on  the  time  and 
position  location  of  significant  tactical  events,  the  recording  of  voice 
transmissions  (VRS)  on  the  company  command  net,  video  recordings  of 
significant  events,  and  any  data  that  might  be  used  to  provide  subjective 
support  for  the  After  Action  Reviews  (AARs). 

c.  Purpose.  The  purpose  of  the  TIE  test  was  to  provide  data  at  the 
company/team  level  that  could  be  used  to  assist  In  the  development  and 
evaluation  of  tactical  engagement  simulation  training  with  Instrumented 
feedback  as  part  of  the  concept  for  a  National  Training  Center. 

d.  Objectives. 

(1)  TIE  objectives  addressed  In  this  report  are  as  follows: 

(a)  Objective  1.  Provide  insights  into  changes  In  the  level 
of  unit  tactical  proficiency  that  occur  when  Instrumented  tactical 
engagement  simulation  is  used  for  training. 

(b)  Objective  2.  Verify  or  revise  provisional  measures  of 
effectiveness  (MOE). 

(2)  The  following  additional  objectives  are  addressed  In  USACDEC 
report.  Training  Instrumentation  Evaluation  (TIE)  Final  Report  dated 
December  1978  (Ref  1). 

(a)  Objective  3.  Gain  Insights  Into  the  nature  and  extent 
of  Information  required  to  provide  the  feedback  and  diagnostic  information 
required  to  Improve  tactical  proficiency. 

(b)  Objective  4.  Provide  Information  to  assist  in  the 
development  of  a  MILES  control  system  and  ultimately  that  for  a  National 
Training  Center. 

e.  Essential  Elements  of  Analysis  (ESA).  The  essential  elements  of 
analysis  addressed  In  this  report  are  outlined  below,  and  the  objective  to 
which  each  relates  Is  Indicated. 

(1)  EEA  1.  Was  there  substantial  agreement  among  the  evaluators 
In  rating  the  level  of  tactical  proficiency  of  the  US  forces? 

(OBJECTIVE  1) 


(2)  EEA  2.  What  was  the  rank-ordered  hierarchy  of  unit  tactical 
proficiency  as  determined  from  the  evaluators'  average  ratings  of  tactical 
proficiency?  {OBJECTIVE  1) 

(3)  EEA  3.  How  does  the  level  of  tactical  proficiency  change 
after  a  series  of  Instrumented  engagement  simulation  training  exercises? 
(OBJECTIVE  1) 

(4)  EEA  4.  What  MOEs  were  most  Indicative  of  the  ratings  of  unit 
tactical  proficiency?  (OBJECTIVE  2) 

(5)  EEA  5.  What  MOEs  were  Indicative  of  learning  occurring  In  a 
particular  area  over  trial  replications?  (OBJECTIVE  2) 

(6)  EEA  6.  What  Insights  can  be  gained  concerning  the  validity 
of  the  MOEs  as  they  were  measured  during  TIE?  (OBJECTIVE  2) 

(7)  EEA  7.  What  Insights  can  be  gained  from  the  TIE  data 
regarding  the  overall  MOE  structure?  (OBJECTIVE  2). 

f.  Scope.  TIE  was  a  two  sided  force-on-force  Instrumented  training 
exercise  that  matched  a  US  tank  heavy  company  team  In  a  movement  to 
contact/hasty  attack  scenario  against  a  reinforced  motorized  rifle  platoon 
in  a  hasty  defense.  It  provided  for  Integration  of  ATGMs  (l.e.,  TOW, 
DRAGON,  and  SAGGER);  the  primary  weapon  system  on  the  M113  (50  Cal  MG); 
the  primary  and  secondary  weapons  on  M60  tanks  (I05mn  and  7.62nm  coax  MG, 
respectively);  and  the  73mm  antitank  gun  (SPG-9).  Appropriate  US  weapon 
systems  were  used  as  surrogates  to  represent  the  threat  weapons.  Infantry 
small  arms  (M16A1)  were  Instrumented  In  a  "stand  alone"  mode  (l.e.,  not 
Interfaced  with  main  computer  system).  Indirect  artillery  fires  could  be 
requested  by  the  players,  and  casualty  assessments  were  made  via  the 
Indirect  Fire  Casualty  Assessment  and  Suppression  (IFCAS)  system. 

Although  anmunitlon  depletion  was  portrayed  during  TIE,  there  was  no  means 
of  portraying  logistics  or  resupply  requirements. 

g.  Test  Concept. 

(1)  The  test  design  of  TIE  was  atypical;  that  Is,  the  TIE  test 
was  not  structured  as  an  ordered  number  of  design  cells,  defined  by 
specific  independent  variables,  containing  a  specific  number  of  trials, 
and  Intended  to  be  compared  statistically  against  one  or  more  of  the  other 
cells.  Instead,  the  test  consisted  of  two  sequences  of  trials  performed 
by  separate  player  groups.  Trials  1-14  were  executed  by  player  group  1 
and  composed  the  first  sequence;  trials  15-22  were  conducted  by  player 
group  2  and  composed  the  second  sequence.  (Trials  1-14  and  15-22  were 
designated  as  101-114  and  201-208  respectively,  to  distinguish  a  set  of 
trial  replications  for  each  player  group.)  Each  sequence  was  considered 
as  an  ordered  series  of  learning  experiences  during  which  the  player  set 
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was  expected  to  Improve  Its  tactical  proficiency.  Each  sequence  was  used 
to  roughly  plot  the  learning  effect  for  that  unit  over  that  particular 
player  set  and  the  order  of  learning  experiences.  In  order  to  establish  a 
rough  estimate  of  the  relative  proficiency  of  the  two  units,  selected 
trials  were  conducted  under  Identical  conditions  with  no  player  feedback. 
For  consistency,  the  same  defensive  player  set  was  used  to  oppose  the  two 
offensive  player  sets.  Numerous  trial  sites  were  used;  and  within  each 
trial  sequence,  the  defensive  posture  was  not  duplicated  on  the  same 
site.  The  order  In  which  sites  and  defensive  postures  appeared  for  the 
first  player  set  was  generally  repeated  for  the  second  player  set. 

(2)  The  post-trial  feedback  sequence  for  the  first  player  set 
consisted  of  two  trials  with  no  AARs  followed  by  six  trials  with  AARs 
using  only  Information  that  had  been  manually  collected  by  controllers. 

The  last  six  trials  had  full  AARs  developed  from  controller  and 
instrumentation  collected  data.  The  first  two  trials  were  used  to  make  a 
subjective  evaluation  of  the  Initial  level  of  unit  tactical  proficiency 
for  comparison  with  the  second  player  set.  The  next  six  trials  provided 
for  a  measure  of  the  learning  from  engagement  without  instrumented 
feedback.  Even  though  feedback  was  controlled  following  this  procedure, 
all  trials  were  Instrumented  and  thus  provided  a  measure  of  learning  In  an 
Instrumented  environment.  This  entire  sequence  for  the  first  player  set 
was  used  as  a  developmental  period  In  which  AAR  and  controller  techniques 
were  refined  and  practiced. 

(3)  The  post-trial  feedback  sequence  for  the  second  player  set 
consisted  of  two  trials  with  no  feedback  to  establish  the  level  of 
tactical  proficiency  relative  to  the  first  player  set,  followed  by  six 
trials  using  the  refined  AAR  techniques  developed  with  the  first  player 
set.  Controller  and  Instrumentation  feedback  were  combined  and  used  in 
the  AARs  for  this  set.  The  last  two  trials  Included  the  use  of  smoke  by 
the  attacking  force. 

h.  Trial  Description. 

(1)  Trials  began  on  4  August  1978  and  continued  through 

14  September  1978.  Table  1  depicts  the  trial  schedule.  Each  trial  lasted 
approximately  2  hours. 

(2)  The  test  was  conducted  In  the  Gabllan  Valley  area  of  Fort 
Hunter  Liggett  (FHl)  -  Map  Stock  No.  V795SHUNTER101.  Within  this  area, 
threat  platoon  positions  were  selected  and  occupied,  and  the  company  team 
was  given  boundaries  within  which  to  conduct  a  movement  to  contact 
maneuver.  The  valley  Is  approximately  3  to  4  kilometers  In  width  and  5 
kilometers  In  length.  Terrain  Is  basically  gently  rolling,  broken  by 
medium  to  deep  ravines  and  scattered  high  hills. 

(3)  The  test  scenario  was  designed  to  create  a  realistic  tactical 
environment  for  a  company  team.  A  synopsis  of  the  actual  scenario  Is 
given  below. 
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Player  Group  1 
Date 


Table  1.  Trial  Schedule 


Day 

4  Aug  Friday 

1  Aug  Monday 

8  Aug  Tuesday 

9  Aug  Wednesday 

10  Aug  Thursday 

11  Aug  Friday 

15  Aug  Tuesday 

16  Aug  Wednesday 

17  Aug  Thursday 

18  Aug  Friday 

21  Aug  Monday 

22  Aug  Tuesday 

23  Aug  Wednesday 

24  Aug  Thursday 


Player  Group  2 


Trial 

Date 

Day 

201 

202 

31  Aug 

1  Sept 

Thursday 

Friday 

203 

5  Sept 

Tuesday 

204 

7  Sept 

Thursday 

205 

206 

207 

208 

11  Sept 

12  Sept 

13  Sept 

14  Sept 

Monday 

Tuesday 

Wednesday 

Thursday 

(a)  A  threat  reinforced  motorized  rifle  platoon  was 
advancing  as  a  part  of  the  lead  company  of  a  motorized  rifle  battalion  In 
the  attack.  The  lack  of  success  of  the  threat  main  effort  forced  a  halt. 
The  threat  platoon  occupied  a  hasty  defense  pending  orders  to  advance  or 
to  occupy  a  deliberate  defense.  The  threat  platoon,  with  dismounted 
antitank  (AT)  support  from  battalion,  was  portrayed  as  operating  at 
slightly  reduced  strength  due  to  the  US  covering  force  action  but  had 
received  some  resupply  of  ammunition.  If  attacked,  the  platoon  was  to 
defend  In  place  until  reinforced  or  ordered  to  withdraw. 

(b)  On  the  US  side,  the  covering  force  had  just  completed 
its  hand-off  of  the  battle  to  the  units  occupying  the  main  battle  area. 

To  take  advantage  of  the  lack  of  enemy  success  in  his  main  effort,  these 
US  forces  not  opposed  by  the  main  effort  were  ordered  to  attack.  The 
company  team,  which  was  occupying  a  battle  position  in  the  main  battle 
area,  was  designated  as  the  lead  element  for  a  task  force  that  was  to 
attack  as  part  of  the  division's  secondary  effort.  Intelligence  available 
to  the  company  team  commander  indicated  that  enemy  forces  of  about  company 
strength  or  less  had  occupied  a  position  to  his  front.  Due  to  the  nature 
of  the  enemy's  unexpected  halt  and  the  recent  passage  of  the  covering 
force,  the  disposition  of  the  enemy  forces  was  unknown.  Although  short 
two  tanks  per  platoon,  the  company  team's  supply  situation  was  good.  All 
team  weapons  and  supporting  artillery  had  a  full  basic  load  on  hand.  The 
company  was  ordered  to  move  to  the  high  ground  to  its  front  and  to  be 
prepared  either  to  establish  an  overwatch  position  for  the  rest  of  the 
task  force  or  to  continue  the  attack,  depending  on  the  situation.  If 
enemy  contact  was  made,  the  company  was  to  develop  the  situation  and 
continue  the  advance,  if  possible.  Authority  to  bypass  enemy  locations 
was  retained  by  the  battalion  comnander.  Contact  with  the  enemy  was 
likely. 

(4)  The  US  force  consisted  of  a  tank  heavy  company  team 
reinforced  by  additional  AT  weapons  and  supported  by  indirect  fire 
weapons.  The  US  force  structure  is  shown  in  figure  1.  All  indirect  fires 
were  simulated.  Two  identically  organized  player  sets  were  used.  To  the 
greatest  extent  possible,  tactical  free  play  was  used  during  each  trial. 
The  team  comnander  was  not  allowed  to  bypass  any  element  unless  permission 
was  granted  by  Test  Directorate  personnel  representing  the  battalion 
headquarters.  Here,  the  intention  was  to  encourage  the  employment  of  the 
infantry  elements  so  that  their  learning  could  be  observed. 

(5)  The  threat  force  consisted  of  elements  of  a  motorized  rifle 
company  reinforced  with  tanks  and  battalion  AT  weapons  and  supported  by 
indirect  fire.  The  threat  force  structure  with  a  summary  of  player 
personnel  and  weapons  played  is  shown  in  figure  2.  Indirect  fire  weapons 
were  simulated.  For  test  control,  the  tank  platoon  leader  commanded  the 
entire  threat  force.  Current  Soviet  doctrine  for  the  employment  of  forces 
and  conduct  of  the  hasty  defense  was  followed.  Threat  force  actions  were 
designed  to  realistically  develop  the  action  against  the  attacking  US 


Figure  2.  Threat  force  structure. 


force.  The  defensive  play  was  free  during  the  conduct  of  trials  except 
when  controller  personnel  Interjected  specific  rules  of  engagement  to 
force  tactical  situations  of  interest. 

i.  Instrumentation/Data  Collection.  Data  requirements  to  support  the 
provisional  list  of  MOEs  were  identified  prior  to  TIE  and  were 
Incorporated  into  the  data  collection  process  at  CDEC.  Position  location 
and  fire/hlt/kill  event  data  were  transferred  to  the  United  States  Army 
Combined  Arms  Combat  Development  Activity  (CACDA)  on  computer  tapes. 

(1)  Objective  data  were  collected  by  the  CDEC  instrumentation 
system  as  follows: 

(a)  The  Multi -Computer  System  (MCS)  provided  control  and 
Interface  for  other  systems,  automatic  data  recording,  and  casualty 
assessment/kill  event  data. 

(b)  The  Range  Measuring  System  (RMS)  provided  continuous 
location  data  (10-digit  coordinates)  of  each  instrumented  system  (tank, 
antitank  guns,  ATGM,  and  APC). 

(c)  The  Direct  Fire  Simulator  (DFS  -  figure  3)  provided 
fire/hit  event  data  (firer  and  target  identification,  location,  type 
ammunition  expended,  target  posture,  time  of  firing,  etc.).  Only  tanks, 
ATGMs,  APCs,  and  the  SPG-9  antitank  gun  were  instrumented  with  DFS.  No 
Information  concerning  the  target  of  a  firing  was  available  unless  a  hit 
was  scored. 


(d)  The  Infantry  Direct  Fire  Simulator  (IDFS)  provided 
fire/hlt/kill  event  data  to  Infantrymen  in  a  stand-alone  mode  (not 
automatically  recorded  by  Interface  with  MCS). 

(e)  The  Indirect  Fire  Casualty  Assessment  and  Suppression 
(IFCAS)  System  provided  casualty  assessment  resulting  from  indirect  fire 
and  a  limited  amount  of  artillery  Impact  cuing  on  the  battlefield. 

(f)  The  Voice  Recording  System  (VRS)  provided  time-tagged 
voice  recordings  of  tactical  radio  traffic. 

(g)  The  Photographic  Instrumentation  and  Data  Recording 
System  (PIDRS)  provided  time-tagged  black  and  white  video  recordings  of 
critical  events. 

(2)  Subjective  data  and/or  chronological  listing  of  significant 
events  were  manually  recorded  on  evaluator  forms  during  the  exercise  by 
TIE  evaluators.  Evaluators  were  assigned  to  each  platoon,  the  TOW 
section,  and  the  FO  of  the  US  company/team. 
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2.  METHODOLOGY. 


a.  Data  Base. 

(1)  While  all  trials  of  the  second  player  set  yielded  useful 
data,  only  10  of  the  14  trials  conducted  In  the  first  player  set  were 
usable.  Due  to  Instrumentation  problems,  data  from  trials  101  and  104 
were  determined  to  be  Invalid.  Trials  102  and  103  were  valid  for  data 
collection,  but  the  test  conditions  were  Inconsistent  with  the  remaining 
trials.  It  was  feared  a  significant  bias  In  the  data  could  occur  from 
these  trials,  and  they  were  dropped  from  the  analysis.  Inconsistencies 
within  the  test  conditions  Included: 

(a)  The  Effective  Force  Ratio  (EFR),  which  was  designed  to 
be  a  constant,  was  disrupted  by  instrumentation  difficulties  In  the  early 
trials.  Though  all  the  threat  systems  shown  In  figure  2  were  present  in 
all  exercises  and  could  draw  fire  and  be  killed,  only  those  listed  below 
were  capable  of  causing  casualties  and  were  fully  effective: 

.  Trial  101:  SP6-9 

.  Trial  102:  2  each  T-62s 

.  Trial  103:  2  each  T-62s,  1  each  SPG-9 

.  Trial  104:  2  each  T-62s,  1  each  SPG-9 

.  Trial  105:  2  each  T-62s,  2  each  BMP/SAGGERS, 

1  each  SPG-9 

.  The  full  complement  of  effective  OPFOR  weapons  was  available  In 
all  remaining  trials. 

This  Instrumentation  problem  resulted  In  an  EFR  (Blue/Red)  of  7:1  for 
trial  102  and  4.7:1  for  trial  103  as  compared  to  2.8:1  for  the  rest  of  the 
trials.  The  antitank  EFR  (Blue/Red)  was  5:1  for  trial  102  and  3.3:1  for 
trail  103  as  opposed  to  2:1  for  the  remaining  trials.  Also,  the  OPFOR  had 
no  long  range  antitank  capability  for  trials  102  and  103.  During  each  of 
these  trials  the  BMP/SAGGERs  were  destroyed  by  the  US  forces  after  they 
had  attempted  to  engage  targets. 

(b)  In  trial  102  the  defensive  weapon  positions  employed  by 
the  OPFOR  were  established  In  a  relatively  small  area.  Starting  with 
trial  103  and  continuing  throughout  the  remaining  trials,  the  defense  was 
opened  up  to  accommodate  the  greatest  part  of  the  avenue  of  approach 
(figure  4  provides  a  graphical  comparison  of  the  OPFOR  weapon  locations  In 
a  closed  versus  an  open  defense).  Thus,  the  OPFOR  was  modifying  and 
refining  the  defensive  tactics  while  encountering  an  EFR  that  was  more 
than  double  what  It  would  be  during  the  remaining  trials. 


(2)  The  primary  analysis  effort  was  concentrated  on  the  output 
from  the  sequence  of  trials  conducted  by  the  second  player  set.  Data  from 
the  first  player  set  trial  sequence  were  used  to  verify  and  support 
findings  resulting  from  this  primary  analysis  effort.  Justification  to 
concentrate  on  player  set  2  Includes  the  following  rationale. 

(a)  More  supplemental  data  were  available  for  player  set  2 

Including: 

.  Video  recordings  of  key  events 

.  Controller  dally  performance  records  based  on  ARTEP 
type  tasks  recorded  by  platoon/section  evaluators 

(b)  The  entire  sequence  for  the  first  player  set  was  used  as  a 
developmental  period  In  which  After  Action  Review  (AAR)  and  controller 
techniques,  as  well  as  defensive  OPFOR  tactics,  were  refined  and 
practiced.  Any  of  the  following  factors  might  have  Introduced  a 
considerable  bias: 

.  Learning  process  of  the  OPFOR. 

.  Learning  process  of  the  controllers/evaluators. 

.  Changes  and  modifications  made  to  the  AAR  (e.g.,  AARs 
with  and  without  feedback  provided  by  instrumentation, 
ascending  chain  of  command,  descending  chain  of 
command,  and  seminar  type  AARs  were  evaluated  In  the 
first  sequence). 

(c)  More  evaluators  were  available  during  player  set  2  to  rate 
the  overall  unit  proficiency.  Based  on  this  Increase  in  evaluations  a 
more  reliable  mean  rating  of  the  each  unit's  proficiency  was  expected  for 
each  trial. 

(d)  The  results  of  the  second  sequence  of  trials  were  expected 
to  be  more  reliable  and  valid  since  the  test  conditions  were  more  tightly 
controlled.  Figure  5  is  a  schematic  representation  of  the  relationship 
between  the  variables  in  effect  and  the  trials  of  player  set  2.  Figure  6 
depicts  the  OPFOR  defensive  area  of  operations. 


Figure  5.  Relationship  between  the  variables  in  effect  during  TIE  and  trials  201  through  208. 

Asterisk  In  variable  11  represents  previously  unused  terrain.  After  Action  Review  (AAR),  Feedback 
Session  (FS),  Remedial  Training  (RT),  Quadrant  (Q). 


b.  Measuring  Tactical  Proficiency. 


(1)  For  each  player  group,  the  trials  were  rank-ordered  based 
upon  the  average  of  the  evaluators'  ratings  of  overall  unit  tactical 
proficiency  as  determined  from  question  number  2  of  the  TIE  Test 
Directorate  Opinion  Questionnaire  (table  2).  This  questionnaire  was 
administered  for  each  trial  to  qualified  personnel  within  the  test 
directorate,  to  Include  participants  from  the  CDEC  project  team,  CATRADA, 
TRADOC  System  Manager  -  Tactical  Engagement  Simulation  (TSM-TES),  ARI,  the 
CDEC  Instrumentation  support  team,  and  the  CDEC  scientific  support 
laboratory.  In  order  to  assure  comparability  of  judgments  among  trials 
and  between  player  groups,  respondents  were  constrained,  as  far  as 
practical,  to  have  had  a  direct  and  continuous  observation  of  the  sequence 
of  trials  In  the  test.  The  average  level  of  proficiency  for  each  trial  of 
each  player  set  was  computed  from  the  respective  distribution  of  the 
evaluators'  ratings  of  tactical  proficiency.  To  provide  a  hierarchy  of 
proficiency,  the  trials  for  each  player  group  were  subsequently 
rank-ordered  according  to  the  average  ratings.  In  each  player  set  two 
trials  had  identical  average  ratings  of  proficiency,  and  both  were 
assigned  an  average  rank. 

(2)  An  evaluator  was  assigned  to  the  company  headquarters ,  each 
platoon,  and  the  TOW  section  of  the  US  company/team  throughout  the  TIE 
trials.  These  evaluators  recorded  a  chronological  listing  of  significant 
events  of  the  trial  and  during  player  set  2  maintained  a  Controller  Daily 
Performance  Record  (CDPR).  The  CDPR  was  designed  to  permit  the  evaluators 
to  rate  their  platoon/ sect ion  In  particular  functional  areas  as  determined 
by  ARTEP  71-2  on  the  7-polnt  Likert  scale  (same  as  used  on  the  TDOQ): 

1  2  3  4  5  6  7 

Ineffective  Effective 

Table  3  depicts  the  functional  areas  rated  by  the  evaluators  on  the  CDPR. 

(a)  The  proficiency  of  player  set  2  In  each  of  the  primary 
functional  areas  was  determined  by  the  average  of  the  evaluators'  ratings 
on  the  CDPR.  The  trials  were  subsequently  rank-ordered  according  to  the 
average  ratings.  These  hierarchies  of  proficiency  relating  to  specific 
functional  areas  were  then  correlated  to  trial  sequence  using  the  Spearman 
technique  for  correlating  ranks.  To  identify  convincing  relationships 
between  the  rankings  of  specific  proficiencies  and  trial  sequence  ( 1 .e. , 
learning  trends  for  the  proficiencies),  the  resulting  correlations  were 
examined  for  statistical  significance  at  the  .05  level. 

(b)  The  average  of  the  evaluators'  ratings  on  the  CDPR  were 
then  aggregated  across  all  the  functional  areas  to  determine  an  overall 
rating  of  the  tactical  proficiency.  These  composite  ratings  were 
subsequently  rank-ordered,  and  the  resulting  hierarchy  of  proficiency  was 
correlated  with  trial  sequence  using  the  Spearman  technique.  As  before, 
the  correlation  was  examined  for  significance  at  the  .05  level. 


Table  2. 

TIE  Test  Directorate  Opinion  Questionnaire 
(Continued  on  next  page) 

This  questionnaire  Is  designed  to  elicit  judgments  and  opinions  from  test 
directorate  personnel  on  subjects  vital  to  addressing  the  objectives  and 
essential  elements  of  analysis  of  the  TIE  test.  Please  answer  the  following 
questions,  where  applicable.  In  as  great  detail  as  you  can.  If  a  question  Is 
not  applicable  to  you,  please  Indicate  "N/A". 

Respondent  ____________________________  Parent  Conmand  _________________ 

Date _ Position  __ _ 

1.  How  does  the  basic  level  (pretest)  of  proficiency  of  this  player  group 
compare  to  that  of  the  preceding  player  group?  Please  categorize  your 
responses  Into  those  areas  of  unit  performance  that  you  believe  best  describes 
unit  tactical  proficiency. 

2.  What  was  the  level  of  proficiency  of  the  U.S.  force  during  the  latest 
trial? 

Trial  Date _ 

Rating 


_  Not  Observed 

7 _  Excellent 

6 _  Very  Good 

5 _  Good 

4 _  Fair 

3 _  Borderline 

2 _  Poor 

1  Very  Poor 


3.  Has  the  U.S.  Force  Improved  since  the  preceding  trials? 

4.  Do  the  provisional  MUTP  adequately  measure  unit  performance? 

5.  Can  you  suggest  alternative  MUTP  which  might  better  reflect  unit 
performance? 
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Table  2  (Concluded) 

6.  What  feedback  (AAR)  Information  Is  most  helpful  to  the  chain  of  command  In 
correcting  training  deficiencies? 

7.  Which  MUTP  might  be  helpful  to  the  chain-of-comnand  In  correcting  training 
deficiencies? 

8.  What  additional  RTCA  Information  can  be  collected  and/or  displayed  (In 
real  time)  to  the  players  In  order  to  Improve  the  training  experience  or  make 
It  more  realistic? 

9.  What  RTCA  Information,  that  Is  now  collected  and  or  displayed  (In  real 
time)  to  the  players,  is  unnecessary  or  redundant? 

10.  Are  there  additional  data  that  should  be  collected  manually  during  the 
trial  In  order  to  provide  superior  feedback  Information  to  the  players? 

11.  Can  you  suggest  alternative  methods  of  displaying  feedback  information  to 
the  players  (such  as  plots,  charts,  tables)  that  would  improve  the  AAR? 


1.  PREPARE 
FOR 

MOVEMENT 

2.  CONDUCT 
MOVEMENT 


3.  TRAVELING 
OVERWATCH 
MOVEMENT 


4.  BOUNDING 
OVERWATCH 
MOVEMENT 
TECHNIQUE 


5.  OCCUPY 
OVERWATCH 
POSITION 


Table  3 

CONTROLLER  DAILY  PERFORMANCE  RECORD  CHECKLIST 
(Continued  on  next  page) 

1.1  Preparation  and  delivery  of  the  warning  order 

1.2  Preparation  and  delivery  of  the  operations  order 


2.1  Coordinate  firepower 

2.2  Locate  opposing  force 

2.3  Appropriate  movement  technique 

3.1  Lead  elements  move  continuously 

3.2  Lead  elements  use  cover  and  concealment 

3.3  Trial  elements  move  at  various  speed  and  stop  in 
hull-down  positions 

3.4  Trial  elements  key  moves  to  terrain  &  overwatch 

3.5  Trial  elements  position  for  supporting  firing 

3.6  Trial  elements  moves  controlled  by  visual  signals 

4.1  Overwatch  done  from  covered  and  concealed  positions 

4.2  Overwatch  position  can  see  area  of  bounding  element 

4.3  Overwatch  fire  suppressive  fires  on  likely  positions 

4.4  Overwatch  position  to  maneuver  if  required 

4.5  Bounding  element  uses  terrain  to  mask  movement 

4.6  Bounding  element  uses  cover  and  concealment  at 
destination 

4.7  Bounding  element  becomes  overwatch,  observes  front 
and  flanks 

4.8  Movement  is  controlled  by  visual  signals  when 
possible 

5.1  Moves  into  position  without  exposing  vehicle 

5.2  Platoon  positions  vehicles  hull-down 

5.3  Crews  observe  dominating  terrain 

5.4  Crews  prepare  to  fire  on  likely  positions 

5.5  Crews  use  terrain  for  cover  and  concealment 

5.6  Crews  move  vehicles  to  provide  constant  overwatch 

5.7  Crews  observe  assigned  areas  including  air  space 

5.8  Crews  report  any  potential  targets 


6.  MOVEMENT  FROM  OVERWATCH  POSITION 


7.  REACT  TO  CONTACT 

8.  CONDUCT  8.1 

HASTY 

ATTACK  8.2 

8.3 


Conduct  hasty  attack  to 
disposition 

Evaluate  resistance  and 
Calls  for  Inmedlate  and 


determine  strength  and 

react  accordingly 
planned  fires 
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Table  3  (concluded) 


8.4  FRAG  orders  are  clear  and  complete 

8.5  Maximum  use  of  protective  cover  and  concealment 

8.6  Units  support  each  other  with  max  suppressive  fire 

9.  SECURE  9.1  Dismounted  attack  on  antitank  weapons 

OBJECTIVE  9.2  Secure  objective  without  excessive  losses 

9.3  Consolidate,  reorganize,  and  prepare  to  continue 

10.  SUBMIT  REPORTS.  SECURE  MEANS  USED  FOR  LOCATION,  TERRAIN  AND  SITUATION 

11.  CALL  FOR  11.1  Selects  proper  caliber  of  weapons/munitions 

FIRES  ON  11.2  Correct  grid  and  OT  line 

TARGETS  11.3  Correct  adjustments  made 

IDENTIFIED  11.4  Assists  team  commander  in  preparing  fire  plan 
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.  Verifying  Measures  of  Tactical  Prof 1 clenc; 

(1)  The  evaluator  ratings  from  the  TIE  Test  Directorate  Opinion 
Questionnaire  (TDOQ)  were  analyzed  to  determine  if  there  was  substantial 
agreement  among  the  raters  In  recording  the  level  of  proficiency  of  the  US 
forces  during  each  trial. 

(a)  The  coefficient  of  concordance  as  explained  by  Conover 
(Ref  2)  was  proposed  to  test  the  following  hypothesis  (significance  level 
-.05): 

Ho:  The  evaluators  demonstrated  no  consistent  preference. 

Hl:  The  evaluators  demonstrated  a  consistent  preference. 

(b)  In  addition,  the  standard  deviations  of  the  evaluators' 
ratings  as  determined  from  the  TDOQ  were  computed. 

(2)  To  validate  the  TDOQ  as  an  overall  measure  of  proficiency  as 
outlined  by  ARTEP  tasks,  the  Spearman  rank  correlation  coefficient  was 
used  to  determine  If  there  was  significant  agreement  between  the 
rank-order  as  determined  by  the  TDOQ  and  that  provided  by  the  CDPR  (as 
developed  by  the  controllers  and  ARI  from  ARTEP  71-2).  This  analysis 
Included  two  types  of  comparisons: 

(a)  A  comparison  of  the  overall  unft  proficiency  as  computed 
by  the  TDOQ  with  the  overall  proficiency  as  determined  by  the  CDPR 
(significance  level  *  .05). 

H0:  The  unit  proficiency  as  determined  by  TDOQ  Is  not 

related  with  unit  proficiency  as  determined  6y 
the  CDPR. 

Hl:  There  is  a  correlation  between  the  proficiency 

ratings. 

(b)  Again  using  Spearman  correlations,  the  proficiency 
ratings  of  each  functional  area  were  compared  to  the  overall  proficiency 
rating  of  the  unit.  This  comparison  Identified  those  specific  areas  that 
correlate  closely  to  the  overall  unit  proficiency. 

d.  Detection  of  a  Learning  Curve.  If  a  test  unit,  participating  in  a 
sequence  of  trials,  becomes  more  proficient,  then  it  Is  expected  that  the 
latter  trial  ranks,  In  terms  of  tactical  proficiency,  would  show  a 
monotonic  nondecreasing  tendency.  The  tactical  proficiency  ranks  were 
correlated  with  the  order  of  trials  to  determine  if  such  a  trend  existed. 


e.  Statistical  Testing  of  MOEs. 

(1)  Computation.  Those  MOEs  that  were  tractable  and  quantifiable 
were  computed  from  automated  data  files  or  by  retrieval  from  manual  data 
collection  forms. 

(2)  NOE  vs  tactical  proficiency.  Candidate  MOEs  that  could  be 
computed  were  ranked  and  then  correlated  to  the  rank  of  tactical 
proficiency  as  determined  from  the  TDOQ.  The  resulting  correlations  were 
examined  for  two-tailed  statistical  significance  at  the  .10  level.  The 
following  hypothesis  applied: 

H0:  MOE  and  tactical  proficiency  (TP)  are  not 
correlated. 

Hi:  Either 

.  There  is  a  tendency  for  the  larger  values  of  the 
MOE  to  be  paired  with  larger  values  of  TP. 

.  There  is  a  tendency  for  the  smaller  values  of  the 
MOE  to  be  paired  with  larger  values  of  TP. 

(3)  MOE  vs  trial  replication.  Those  MOEs  that  could  be  computed 
were  also  ranked  and  then  correlated  to  trial  sequence  to  detect  the 
existence  of  trends  in  the  MOEs  as  experience  was  gained.  The  following 
hypothesis  applied: 

Assmnption:  (two-tailed  test  with  signifance  level  »  .10) 

H0:  MOE  and  trial  sequence  (TS)  are  not  correlated. 

Hl:  Either 

.  There  is  a  tendency  for  the  values  of  the  MOE  to 
Increase  with  trial  sequence 

.  There  is  a  tendency  for  the  values  of  the  MOE  to 
decrease  with  trial  sequence 

(4)  Categories.  MOEs  were  categorized  under  the  following 
priorities  for  both  tactical  proficiency  and  trial  sequence: 

(a)  Priority  1: 

.  Significant  trend  with  tactical  proficiency  (or  trial 
sequence)  for  player  set  2  or  across  both  player  sets. 
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.  Consistent  trend  across  both  player  sets. 

(b)  Priority  2: 

.  Significant  trend  with  tactical  proficiency  (or  trial 
sequence)  for  player  set  1  only. 

.  Significant  trend  with  tactical  proficiency  (or  trial 
sequence)  for  either  player  set  with  an  opposite  trend 
apparent  in  the  other  player  set. 

(c)  Undetermined:  Insufficient  data  were  obtained  during  TIE 
to  determine  a  reliable  estimate  of  these  MOE. 

f.  Cluster  Analyses.  To  gain  insights  into  the  total  MOE  structure 
two  types  of  cluster  analyses  were  performed. 

(1)  The  first  procedure  clustered  the  MOEs  based  on  the  sample 
correlations  existing  among  these  measures. 

(2)  The  second  clustering  procedure  attempted  to  identify  similar 
data  patterns  in  the  variables-by-cases  data  matrix.  This  procedure 
provided  insights  into  the  relationship  of  the  trial  sequence  and  MOE 
structure. 

g.  Priority  MOE.  A  more  detailed  analysis  was  made  of  selected 
Priority  i  MOE,  as  determined  in  2e(4),  to  gain  insights  on  how  these  MOE 
and  relevant  data  can  be  presetted  more  effectively  to  the  unit 
commanders/ 1 eaders . 

h.  Graphic  Display.  The  smoothed  position  location  and  event  data  of 
the  second  player  set  of  TIE  were  displayed  graphically  on  the  Battlefield 
Visual  Graphics  System  (BVGS)  at  CACDA.  This  procedure  allowed  a  means  of 
replaying  the  trials  for  post-trial  analysis. 

1.  Video  Display.  Black  and  white  video  tapes  of  trials  105  through 
108  were  reviewed,  edited,  and  analyzed  to  supplement  the  hardcopy  data 
output  and  the  graphic  battle  portrayals. 

3.  DATA  ANALYSIS/RESULTS/CONCLUSIONS. 

a.  General «  TIE  was  an  exploratory  experiment,  and  most  of  the 
findings  provide  only  insights  and  indications  as  to  what  might  be 
expected  in  subsequent  NTC  development.  Conclusions  are  based  largely  on 
subjective  evaluations  supported  where  possible  by  objective  analysis  of 
available  data.  The  objectives  and  EEAs  are  presented  in  this  section 
with  the  relevant  findings. 


b.  OBJECTIVE  1:  Provide  Insights  into  changes  in  the  level  of  unit 
tactical  proficiency  that  occur  when  Instrumented  tactical  engagement 
simulation  is  used  for  training. 

(1)  EEA  1.  Was  there  substantial  agreement  among  the  evaluators 
in  rating  the  level  of  tactical  proficiency  of  the  US  forces? 

(a)  Insufficient  data  were  recorded  to  estimate  the  effect 
between  evaluators  or  to  determine  the  level  of  agreement. 

(b)  Summary  statistics  from  the  frequency  distributions  of 
the  TDOQ  evaluators'  ratings  are  depicted  in  table  4.  Since  the 
evaluators'  ratings  displayed  a  large  variance,  and  since  much  of  the 
analysis  on  MOEs  was  highly  dependent  on  these  ratings,  it  was  necessary 
to  be  aware  of  these  rating  characteristics  prior  to  performing  analysis. 

(2)  EEA  2.  What  was  the  rank-ordered  hierarchy  of  unit  tactical 
proficiency  as  determined  from  the  evaluators'  average  ratings  of  tactical 
proficiency  on  the  TDOQ  and  the  CDPR? 

(a)  For  player  set  2,  a  statistically  significant  correlation 
established  a  trend  between  rank-orders  of  proficiency  as  determined  by 
TDOQ  and  CDPR.  This  relationship  is  depicted  in  figure  7. 

(b)  Statistical  tests  for  trends  between  the  ranks  of  overall 
proficiency  as  derived  from  the  TDOQ  data  and  the  rankings  of  proficiency 
in  specific  functional  areas  indicated  that  the  rankings  of  proficiency  in 
nine  out  of  ten  tasks  were  highly  correlated  with  overall  tactical 
proficiency.  The  rankings  of  "movements  from  overwatch  positions"  (task 
6)  did  not  follow  the  trend  of  overall  proficiency,  and  no  data  were 
collected  concerning  "call  for  fires  on  targets  identified"  (task  11). 

(3)  EEA  3.  How  does  the  level  of  tactical  proficiency  change 
after  a  series  of  instrumented  engagement  simulation  training  exercises? 

(a)  Table  5  depicts  the  hierarchy  of  tactical  proficiency  for 
each  player  set  as  determined  from  the  TDOQ  data,  and  figure  8  represents 
It  graphically. 

(b)  Statistical  tests  for  trends  in  proficiency  ranking  with 
trial  sequences,  using  the  Spearman  correlations,  substantiated  the 
results  apparent  from  the  inspection  of  figure  8. 


Table  4.  Summary  Statistics  of  Evaluator  Ratings  of 
Tactical  Proficiency  as  Recorded  on  TDOQ 


Trial 

Average  Evaluator 

Rati ng 

Standard 

Deviation 

Sample 

Size 

(Number  of 
Evaluators) 

102 

4.33 

1.12 

9 

103 

4.33 

1.12 

9 

105 

3.67 

1.41 

9 

106 

3.22 

1.64 

9 

107 

5.33 

.87 

9 

108 

3.75 

1.28 

8 

109 

4.22 

1.20 

9 

110 

5.25 

.71 

8 

111 

3.38 

1.51 

8 

112 

4.67 

.52 

6 

113 

3.22 

1.48 

9 

114 

3.75 

1.28 

8 

201 

3.44 

1.09 

16 

202 

3.06 

1.48 

16 

203 

3.33 

1.23 

15 

204 

3.44 

1.46 

16 

205 

4.57 

1.60 

14 

206 

4.13 

.83 

15 

207 

5.20 

.77 

15 

208 

5.60 

.83 

15 

NOTE:  Data  for  trials  101  and  104  were  not  valid  due  to  instrumentation 
problems.  Trials  102  and  103,  while  yielding  data,  were  not  included  in 
the  analysis  as  explained  in  paragraph  2a(l). 


Table  5.  Proficiency  Rank-Order  by  Trial  (TDOQ) 

Player  Group  1  Player  Group  2 

Proficiency  Proficiency 


Trial 

Ranking 

Trial 

Ranking 

105 

4 

201 

3.5 

106 

1.5 

202 

1 

107 

10 

203 

2 

108 

5 

204 

3.5 

109 

7 

205 

6 

110 

9 

206 

5 

111 

3 

207 

7 

112 

8 

208 

8 

113 

1.5 

114 

6 

27 


.  Player  Set  1:  The  null  hypothesis  stating  that 
there  is  no  trend  between  proficiency  and  trial 
sequence  cannot  be  reasonably  rejected. 

.  Player  Set  2:  The  null  hypothesis  can  be  rejected, 
with  .05  signficance  level,  and  thus  the  alternative 
hypothesis  stating  that  proficiency  increases  over 
trial  sequence  ( 1 .e. ,  data  Indicate  a  learning  curve) 
can  be  accepted. 

(4)  Summary/Concluslons  (OBJECTIVE  1). 

(a)  The  available  data  indicated  that  there  was  a  considerable 
degree  of  variance  among  the  evaluators'  ratings  of  tactical  proficiency. 
Included  among  the  factors  possibly  contributing  to  this  variance  are: 

1.  The  evaluators  had  varying  degrees  of  background  and 
experience  (e.g.,  company  grade  and  field  grade  officers,  different  levels  of 
military  schooling  (basic,  advanced  courses,  CGSC),  etc.). 

2.  The  evaluators  observed  the  trials  from  different 
vantage  points  (OPs,  helicopters,  positions  in  the  battle  area,  etc.). 

(b)  The  average  of  the  evaluators'  ratings  from  the  TDOQ  were 
shown  to  be  consistent  to  the  average  of  the  evaluators'  ratings  from  the 
CDPRs  both  In  overall  proficiency  and  across  most  functional  areas.  This 
supports  the  validity  of  using  the  proficiency  rankings  in  analyzing  the 
MOEs.  It  Is  also  Indicative  that  the  individual  evaluator  observations,  used 
to  determine  the  ratings,  were  consistent  with  task  analyses  derived  from  the 
ARTEP. 

(c)  It  may  be  advantageous  to  establish  task  definitions  for 
future  NTC  tests  and  evaluations  for  the  following  reasons: 

1.  Feedback  to  the  unit  would  provide  specific  areas  of 
weakness/deficiency  as  well  as  an  overall  rating  of  proficiency. 

2.  The  unit  could  more  readily  design  a  training  program 
geared  toward  Its  Ipeclflc  needs. 

3.  Wherever  possible  the  evaluators'  subjective  ratings  of  a 
specific  task  coul?  be  supplemented  by  objective  data/MOEs  related  to  that 
task.  Minimum  standards  and  criteria,  developed  analytically  and  verified  by 
empirical  data,  could  be  established  to  Insure  the  subjective  evaluations  are 
valid  and  reliable. 

(d)  The  TIE  analysis  Indicates  that  the  level  of  tactical 
proficiency  for  player  group  2  Increased  during  a  series  of  Instrumented 
engagement  simulation  training  exercises.  The  observation  that  this  trend 


was  not  apparent  for  player  group  1  can  be  attributed  to  fluctuations  In 
variables  as  described  In  para  2a. 

c.  OBJECTIVE  2:  Verify  or  revise  provisional  measures  of 
effectiveness  (MOE).  (Table  6  contains  an  ordered  listing  of  the 
provisional  MOEs.) 

(1)  EEA  4.  What  MOEs  were  most  Indicative  of  the  ratings  of  unit 
tactical  proficiency? 

(a)  With  regard  to  tactical  proficiency,  tables  7  and  8 
depict  those  MOEs  that  were  categorized  as  priority  1  and  2,  respectively 
(see  para  2e(3)). 

(b)  Table  9  depicts  those  MOE  for  which  Insufficient  data 
were  collected  during  TIE  to  do  a  proper  analysis. 

(c)  Figures  9  and  10  depict  two  TIE  MOE  that  appear  as 
fairly  Indicative  of  the  average  ratings  of  tactical  proficiency.  Figure 
11  portrays  two  seemingly  less  meaningful  MOE.  However,  when  properly 
expressed  as  a  ratio,  it  Is  precisely  these  two  MOE  that  yield  relative 
weapon  survivability,  one  of  the  best  Indicators  of  the  rating  of  tactical 
proficiency  (figure  12).  Figures  13  through  25  Illustrate  other  ratio 
type  MOE  from  the  TIE  test  that  exhibit  a  pronounced  relationship  with  the 
average  ratings  of  tactical  proficiency. 

(2)  EEA  5.  What  MOEs  were  indicative  of  learning  occurring  in  a 
particular  area  over  trial  replications? 

(a)  With  regard  to  trial  sequence,  tables  10  and  11  depict 
those  MOEs  that  were  categorized  as  priority  1  and  2,  respectively  (see 
para  2e(3)). 


(b)  This  analysis  supported  the  overall  subjective  finding 
that  a  learning  process  over  trial  sequence  in  one  or  both  of  the  player 
groups  did  occur.  In  particular,  evidence  of  learning  appeared  in  the 
following  areas: 


1.  Terrain  driving  by  tracked  vehicles;  use  of  cover 
and  concealment  (ftfJE  4.2-Player  Set  1). 

2.  Taking  advantage  of  protection  afforded  by  armor 
vehicles  (MOE  10.2H  10.3). 
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Table  6.  TIE  MOE  Index  (Continued  on  next  page). 
MOE  1  (QUALITATIVE):  PERCEIVED  VS  ACTUAL  FRIENDLY  SITUATION 


MOE  2  (QUANTITATIVE):  DISTRIBUTIONS  OF  ENGAGEMENT  RANGES 

SUB-MOE  2.1:  MEAN  M60  MAIN  GUN  ASSESSMENT  RANGE 
T?:  MEAN  M60  MAIN  GUN  TRIAL  KILL  RANGE 
777:  MEAN  TOW  ASSESSMENT  RANGE 
O:  MEAN  TOW  TRIAL  KILL  RANGE 

77S:  MEAN  US  ANTITANK  WEAPON  ASSESSMENT  RANGE  (M60  MAIN  GUN, 

TOW,  DRAGON 

2.6:  MEAN  US  ANTITANK  WEAPON  TRIAL  KILL  RANGE  (M60  MAIN  GUN, 

TOW,  DRAGON) 

2.7:  MEAN  THREAT  ANTITANK  WEAPON  ASSESSMENT  RANGE  (T62  MAIN  GUN, 
~  SAGGER  SPG-9) 

2.8:  MEAN  THREAT  ANTITANK  WEAPON  TRIAL  KILL  RANGE  (T62  MAIN  GUN, 
— — —  SAGGER  SPG-9) 

2.9:  RATIO  OF  MEAN  US  ANTITANK  WEAPON  ASSESSMENT  RANGE  TO  MEAN 
THREAT  ANTITANK  WEAPON  ASSESSMENT  RANGE 
2.10:  RATIO  OF  MEAN  US  ANTITANK  WEAPON  TRIAL  KILL  RANGE  TO  MEAN 
THREAT  ANTITANK  WEAPON  TRIAL  KILL  RANGE 

MOE  3  (QUANTITATIVE):  ESTIMATED  PERCENT  OF  TIME  SPENT  IN  OVERWATCH  (DEFINED 

AS  THE  PERCENT  OF  TIME  SPENT  STATIONARY,  WHILE 
OPERATIONAL  FOR  10  MINUTES  OR  MORE). 

SUB-MOE  3.1:  ESTIMATED  PERCENT  M60  TIME  SPENT  IN  OVERWATCH 
377:  ESTIMATED  PERCENT  TOW  TIME  SPENT  IN  OVERWATCH 

MOE  4  (QUANTITATIVE):  RATE  OF  ADVANCE 

SUB-MOE  4.1:  MEAN  OVERALL  RATE  OF  ADVANCE  (TO  LAST  PHASE  LINE  CROSSED) 
T7Z:  NUMBER  OF  ELEMENTS  REACHING  THE  FINAL  PHASE  LINE 

MOE  5  (QUANTITATIVE):  AMMUNITION  EXPENDITURE 

SUB-MOE  5.1:  NUMBER  OF  US  ANTITANK  ROUNDS  (M60  MAIN.  TOW.  DRAGON) 
EXPENDED 

5.2:  NUMBER  OF  THREAT  ANTITANK  ROUNDS  (T62  MAIN,  SAGGER,  SPG-9) 
EXPENDED 

5.3:  RATIO  OF  US  ANTITANK  ROUNDS  TO  THREAT  ANTITANK  ROUNDS 
EXPENDED 


MOE  6  (QUANTITATIVE):  RATIO  OF  TARGETS  ENGAGED  TO  TARGETS  AVAILABLE 

SUB-MOE  6.1:  MEAN  NUMBER  OF  AVAILABLE  TARGETS  (MNAT)  TO  US  FORCE 
O:  RATIO  OF  MNAT  FOR  US  TO  MNAT  FOR  THREAT 


Table  6.  TIE  MOE  Index  (Cont) 


6.3:  RATIO  OF  US  ANTITANK  FIRINGS  (M60  MAIN,  TOW,  DRAGON)  TO 
MNAT 

6.4:  RATIO  OF  US  ANTITANK  ASSESSMENTS  TO  MNAT 
O:  RATIO  OF  US  ANTITANK  TOTAL  KILLS  TO  MNAT 
O:  MEAN  TIME  BETWEEN  US  ANTITANK  FIRINGS 
177:  AVERAGE  TIME  BETWEEN  US  ANTITANK  FIRINGS  AT  EACH  SURVIVING 
TARGET  { SUB-MOE  6.6  x  MNAT)  (MNAT  IS  DEFINED  AS  THE  AVERAGE 
OVER  TIME  OF  AVAILABLE  TARGETS) 


MOE  7  (QUANTITATIVE):  US  CASUALTIES 


SUB-MOE  7.1: 

7.2: 

7.3: 

77*: 


NUMBER  OF  US  WEAPON  SYSTEMS  (M60,  TOW,  APC,  DRAGON)  TOTAL 
KILLED 

NUMBER  OF  US  ANTITANK  WEAPON  SYSTEMS  (M60,  TOW,  APC, 
DRAGON)  TOTAL  KILLED  OR  SURVIVING  WITH  AMMO  DEPLETE 
CASUALTY  EXCHANGE  RATTU( SUB-MOE  8.1  *  SUB-MOE  7.1) 
EFFECTIVE  EXCHANGE  RATIO  (SUB-MOE  8.2  *  SUB-MOE  7.2) 


MOE  8  (QUANTITATIVE):  THREAT  CASUALTIES 

SUB-MOE  8.1:  NUMBER  OF  THREAT  ANTITANK  WEAPON  SYSTEMS  (T62.  BMP,  SPG-9) 
TOTAL  KILLED 

8.2:  NUMBER  OF  THREAT  ANTITANK  WEAPON  SYSTEM  (T62,  BMP,  SPG-9) 
TOTAL  KILLED  OR  SURVIVING  WITH  AMMO  DEPLETE 

MOE  9  (QUANTITATIVE):  NUMBER  OF  TARGET  ENGAGED  BY  MORE  THAN  ONE  US  WEAPON 

SUB-MOE  9.1:  NUMBER  OF  THREAT  TARGETS  NOT  PAIRED  BY  ANY  US  WEAPON 
ST:  MEAN  NUMBER  OF  US  WEAPONS  PAIRING  EACH  THREAT  WEAPON 
ST:  NUMBER  OF  US  M60  AND  TOW  PAIRING  AT  LEAST  ONE  THREAT  WEAPON 
TJ:  NUMBER  OF  US  M60  AND  TOW  PAIRING  At  LEAST  TWO  THREAT 
WEAPONS 


MOE  10  (QUANTATIVE):  PERCENT  OF  TIME  M60  CREWS  SPENT  IN  EACH  POSTURE 

SUB-MOE  10.1:  PERCENT  OF  M60  CREWS  TOTAL  LIVE  TIME  FULLY  EXPOSED 
IO:  PERCENT  OF  M60  CREWS  TOTAL  LIVE  TIME  FULLY  PROTECTED 
1UT:  PERCENT  OF  M60  CREWS  LIVE  TIME  PARTIALLY  EXPOSED  (I.E., 
BUTTONED  UP) 

MOE  11  (QUANTITATIVE):  AMMUNITION  DEPLETE 

SUB-MOE  11.1:  TOTAL  NUMBER  OF  US  WEAPON  SYSTEMS  WITH  AMMO  DEPLETE 

TO:  TOTAL  NUMBER  0F  THREAT  WEAP0N  SYSTEMS  WITH  AMMO  DEPLETE 

MOE  12.1  (QUANTITATIVE):  NUMBER  OF  US  ROUNDS  FIRED  BEFORE  BECOMING 

-  VULNERABLE  (I.E.,  BEFORE  FIRST  PAIRING  BY 

POTENTIALLY  KILLING  THREAT  WEAPON) 
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Table  6.  TIE  MOE  Index  (Cont) 


SUB-MOE  12.1: 
12.2: 


12.3: 

12.4: 


MEAN  NUMBER  OF  M60  MAIN  GUN  ROUNDS  FIRED  BEFORE  BECOMING 
VULNERABLE 

MEAN  NUMBER  OF  M60  MAIN  GUN  ROUNDS  AND  SECONDARY  BURSTS 
FIRED  BEFORE  BECOMING  VULNERABLE 

MEAN  NUMBER  OF  TOW  ROUNDS  FIRED  BEFORE  BECOMING  VULNERABLE 
MEAN  NUMBER  OF  US  ANTITANK  ROUNDS  FIRED  BEFORE  BECOMING 
VULNERABLE  (M60  MAIN  GUN,  TOW,  DRAGON) 


MOE  13  (QUANTITATIVE):  NUMBER  OF  CASUALTIES  BY  INDIRECT  FIRE 


SUB-MOE  13.1: 
- TO: 


13.6: 


NUMBER  OF  US  PERSONNEL  KILLED  BY  INDIRECT  FIRE 
NUMBER  OF  US  VEHICLES  TOTAL  KILLED  THROUGH  PERSONNEL 
ATTRITION  BY  INDIRECT  FIRE 
NUMBER  OF  INDIRECT  FIRE  ASSESSMENTS  AGAINST  US 
NUMBER  OF  THREAT  PERSONNEL  KILLED  BY  INDIRECT  FIRE 
NUMBER  OF  THREAT  VEHICLES  TOTAL  KILLED  THROUGH  PERSONNEL 
ATTRITION  BY  INDIRECT  FIRE 

NUMBER  OF  INDIRECT  FIRE  ASSESSMENTS  AGAINST  THREAT 


MOE  14  (QUANTITATIVE):  RANGE  TO  THREAT  AT  INITIAL  CONTACT 


SUB-MOE  14.1:  RANGE  BETWEEN  CONTACTING  ELEMENTS  AT  INITIAL  CONTACT 

IO:  MINIMUM  RANGE  BETWEEN  OPPOSING  ELEMENTS  AT  INITIAL  CONTACT 
IO:  MAXIMUM  RANGE  BETWEEN  OPPOSING  ELEMENTS  AT  INITIAL  CONTACT 
TO:  MEAN  RANGE  BETWEEN  OPPOSING  ELEMENTS  AT  INITIAL  CONTACT 
TO:  RANGE  SPREAD  AT  INITIAL  CONTACT  (MAX-MIN) 

MOE  15  (QUALITATIVE):  EMPLOYMENT  OF  INFANTRY  IN  ASSAULT 

MOE  16  (QUALITATIVE):  MOVEMENT  TECHNIQUES  OF  UNIT 

MOE  17  (QUALITATIVE):  EFFECTIVE  EMPLOYMENT  OF  COMMUNICATIONS 

MOE  18  (QUALITATIVE):  PERCENT  OF  US  FORCE  HELD  UP  BY  SPECIFIC  THREAT  WEAPONS 

MOE  19  (QUALITATIVE):  EFFECTIVE  FORCE  RATIOS  DURING  THE  BATTLE 

MOE  20  (QUANTITATIVE):  KILLS  INFLICTED  BY  INFANTRY 


SUB-MOE  20.1: 

- 20: 

“20: 

20: 


20: 


20: 


PERSONNEL  KILLS  BY  US  INFANTRY 
ANTITANK  WEAPON  KILLS  BY  US  INFANTRY 
NUMBER  OF  ASSESSMENTS  BY  US  INFANTRY 
PERSONNEL  KILLS  BY  THREAT  INFANTRY 
ANTITANK  KILLS  BY  THREAT  INFANTRY 
NUMBER  OF  ASSESSMENTS  BY  THREAT  INFANTRY 


Table  6.  TIE  MOE  Index  (Concluded) 

HOE  21  (QUANTITATIVE):  PERCENT  OF  US  ANTITANK  FIRINGS  RESULTING  IN 

EFFECTIVE  PAIRINGS  (ACCURACY  OF  US  FIRE) 

(AN  EFFECTIVE  PAIRIN6  IS  A  WITHIN  RANGE  PAIRING  BY  A 
WEAPON  CAPABLE  OF  DESTROYING  THE  TARGET) 

MOE  22  (QUANTITATIVE):  OPFOR  WEAPON  CASUALTIES  PER  US  AT  ROUND  FIRED 

MOE  23  (QUANTITATIVE):  RATIO  OF  US/OPFOR  EFFECTIVE  PAIRINGS 

MOE  24  (QUANTITATIVE):  PERCENT  OF  THREAT  TARGETS  PAIRED 

MOE  25  (QUANTITATIVE):  BATTLE  INTENSITY 


SUB-MOE  25.1:  OPFOR  PAIRINGS  PER  MINUTE 
557?:  US  PAIRINGS  PER  MINUTE 
557J:  OPFOR  WEAPONS  KILLED  PER  MINUTE 
557T:  US  WEAPONS  KILLED  PER  MINUTE 

MOE  26  (QUANTITATIVE):  PERCENT  OPFOR  FORCE  EFFECTIVELY  EMPLOYED  (I.E., 

PAIRING  AT  LEAST  ONE  US  TARGET) 

MOE  27  (QUANTITATIVE):  PERCENT  US  FORCE  EFFECTIVELY  EMPLOYED  (I.E.. 

PAIRING  AT  LEAST  ONE  OPFOR  TARGET) 

MOE  28  (QUANTITATIVE):  EFFECTIVE  (US/OPFOR)  FORCE  RATIO  (I.E.,  RATIO  OF  US/ 

OPFOR  WEAPON  SYSTEMS  THAT  PAIRED  AT  LEAST  ONE  ENEMY 
TARGET) 

NOTE:  MOEs  21  through  28  were  added  to  the  candidate  MOEs  (1  through  20)  as  a 
result  of  this  analysis. 


Table  7.  Priority  1  MOE  (Tactical  Proficiency) 


MOE 

3.1  Percent  of  time  M60  spent  in  overwatch  (1,  l&2)a 

3.2  Percent  of  time  TOW  spent  in  overwatch  (1,  1&2) 

6.1  MNAT  to  US  force  (2,  1&2)  NES  C0RRb 

6.2  Ratio  (US/Threat )MNAT  (1,  1&2)  NEG  CORR 

6.3  Ratio  of  US  firings  to  MNAT  (2) 

6.5  US  AT  total  kills  to  MNAT  (2,  1&2) 

7.1  Number  US  weapon  systems  killed  (1,  1&2)  NEG  CORR 

7.2  Number  of  US  weapon  systems  killed  plus  those  remaining  with  anino 
depletion  (1,  1&2)  NEG  CORR 

8.1  Number  of  threat  weapons  killed  (2,  1&2) 

8.2  Number  of  threat  weapons  killed  plus  those  with  anno  depletion  (1&2) 

7.3  Casualty  exchange  ratio  *  8. 1/7.1  (2,  1&2) 

7.4  Effective  exchange  ratio  <*  8. 2/7. 2  (1,  1&2) 

9.1  Number  of  threat  weapons  not  paired  by  US  weapon  (2,  1&2)  NEG  CORR 

9.2  Mean  number  of  US  weapons  pairing  each  threat  weapon  (2,  1&2) 

9.3  Number  of  M60  and  TOW  pairing  at  least  once  (1,  2.  1&2) 

9.4  Number  of  M60  and  TOW  pairing  at  least  twice  (1&2) 

12.1  Mean  number  of  M60  main  gun  firing  before  being  paired  (2) 

12.2  Mean  number  of  M60  MG  and  7.62mm  firings  before  being  paired  (2) 

21  Percent  of  Blue  AT  firings  resulting  in  effective  pairings  (Accuracy  of 
AT  Fire)  (1,  2,  1&2) 

23  Blue/Red  effective  pairings  (2,  1&2) 

24  Percent  of  threat  targets  effectively  paired  (1,  2,  1&2) 

25.1  Number  of  Red  pairings  per  minute  (2)  NEG  CORR 

25.2  Number  of  Blue  pairings  per  minute  (1&2) 

25.3  Number  of  Red  weapons  killed  per  minute  (2,  1&2) 

25.4  Number  of  Blue  weapons  killed  per  minute  (1,  1&2)  NEG  CORR 

27  Percent  of  Blue  force  effectively  employed  (2,  1&2) 

28  Effective  (Blue/Red)  force  ratio  (2,  1&2) 

al  indicates  player  group(s)  for  which  the  MOE  were  significantly  correlated 
with  tactical  proficiency  ratings.  1  &  2  represents  testing  based  on  data  of 
both  player  groups. 

b.  Indicates  negative  correlation  between  MOE  and  tactical  proficiency 
ratings;  all  others  are  positively  correlated. 


Table  8.  Priority  2  MOE  (Tactical  Proficiency) 


MOE 

14.1  Range  between  contacting  elements  at  Initial  contact  (1)* 

♦Indicates  player  group(s)  for  which  the  MOE  were  significantly  correlated 
with  tactical  proficiency. 


Table  9.  Undetermined  MOE  (Insufficient  Data) 


MOE 

2.1  Mean  M60  gun  assessment  range 

2.2  Mean  M60  main  gun  total  kill  range 

2.3  Mean  TOW  weapon  system  assessment  range 

2.4  Mean  TOW  weapon  system  kill  range 

2.10  Ratio  of  US  to  threat  antitank  weapon  system  mean  total  kill  range 


iber  of  threat  weapon  systems  killed. 


weapon  systems  killed  plus  those  surviving 


Percent  of  US  Weapon  Systems  Surviving 
Percent  of  OPFOR  Weapons  Systems  Surviving 


Figure  11.  Percent  of  weapon  Systems  surviving 


Figure  12.  Relative  weapon  survivability  —  player  set  2. 


effectively  engage  (pair)  OPFOR  weapons  —  player  set  2. 
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Figure  14.  Effective  (US/OPFOR)  force  ratio  -  player  set  2. 


Percent  of  US  antitank  firings  resulting  in  pairings  — *  player  set  2 


weapon  casualties  per  US  AT  round  fired 


Figure  17.  AT  weapon  effective  exchange  ratio  (EER)  —  player  set  2. 


Trial 

Figure  18.  Relative  casualty  exchange  ratio  —  player  set  2. 


Average  Tactlca 


end  of  trial. 


Locate  and  effectively  engage  (pair)  OPFOR  weapons 


21.  Effective  (US/OPFOR)  force  ratio  --  player  set  1. 


Average  Tactical  Proficiency  (TDOQ) 

Percent  of  US  AT  Firings  Resulting  In  Pairings 


Resulting  in  Pairings 


Figure  23.  Relative  Weapon  Survivability  --  Player  Set  1. 


Relative  casualty  exchange 


Effective  Exchange  Ri 


Table  10.  Priority  1  MOE  (Trial  Replication) 


MOE 

3.2 

Percent  of  time  TOW  spent  in  overwatch  (2,  162  )a 

8.1 

Number  of  threat  weapon  systems  killed  (1&2) 

9.1 

9.2 

9.4 

Number  of  threat  weapons  not  paired  by  US  weapons  (1,  2, 
Mean  number  of  US  weapons  pairing  each  threat  (1,  162) 
Number  -of  M60  and  TOW  pairing  at  least  twice  (162) 

,  162)b 
NE6  CORR 

10.2 

10.3 

Mean  percent  of  time  M60  crew  spent  fully  protected  (162) 

Mean  percent  of  time  M60  crew  spent  partially  protected  (1,  162) 

21 

Percent  of  Blue  AT  fire  resulting  In  effective  pairing 

(2,  162) 

23 

Blue/Red  effective  pairings  (162) 

24 

Percent  of  targets  effectively  paired  (2,  162) 

25.1 

Number  of  Red  pairings  per  minute  (1,  2,  162) 

27 

Percent  of  Blue  force  effectively  employed  (1,  162) 

28 

Effective  (Blue/Red)  force  ratio  (EFR)  (1  6  2) 

T.  Indicates  player  group(s)  for  which  MOE  were  significantly  correlated 
with  trial  replication.  1  &  2  represents  testing  based  on  data  of  both 
player  groups. 

b.  Indicates  negative  correlation  between  MOE  and  trial  replication,  all 
others  are  positively  correlated. 
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Table  11.  Priority  2  MOE  (Trial  Replication) 
HOE 

4.2  Number  of  elements  reaching  final  phase  line  (1)* 

20.1  Nunber  of  personnel  killed  by  US  Infantry  (1) 

20.2  Number  of  weapon  killed  by  US  Infantry  (1) 

20.3  Number  of  assessments  made  by  US  Infantry  (1) 


♦Indicates  player  group(s)  for  which  MOE  were  significantly  correlated 
with  trial  replication. 


3.  Target  acquisition  (MOE  9.1,  9.2,  9.4,  24). 

4.  Firing  techniques;  employment  of  hull  defilade  in 
firing  (MOE  8.1,  971,  9.2,  9.4,  21,  23). 

5.  Coordinated  fire  and  maneuver  (MOE  3.2,  23,  27,  28). 

6.  Basic  infantry  tactics  (MOE  20.1,  20.2,  20.3-Player 

Set  1). 


(3)  EEA  6.  What  Insights  can  be  gained  concerning  the  validity 
and  reliability  of  the  MOEs  as  they  were  measured  during  TIE7 

(a)  The  number  of  unpaired  firings  normally  prevelant  In  a 
force-on-force  Instrumented  trial  poses  a  major  problem  in  collecting 
sufficient  data  to  estimate  mean  assessment/kill  ranges  for  specific 
weapons.  During  TIE  the  mean  percent  of  paired  firings  ^“outlined 
in  table  12.  During  TIE  approximately  65  to  80  percent  of  the  US  and  20 
to  50  percent  of  the  OPFOR  antitank  firings  were  unpaired.  More  detailed 
data  of  percent  paired  firings  is  presented  in  table  13.  The  only  actions 
taken  on  an  unpaired  firing  were  to  decrement  the  ammunition  load  of  the 
flrer  by  one  round.  No  data  were  collected  on  the  flrer's  position, 
posture,  etc.  during  an  unpaired  firing. 

(b)  While  TIE  provided  Insufficient  data  to  evaluate  the 
mean  assessment/kill  ranges  of  similar  weapon  systems  as  suitable  MOE,  It 
was  apparent  that  aggregating  such  measures  across  weapon 

varying  designs,  purposes,  and  effective  ranges  provided  MOE  that  could  be 
easily  misconstrued. 

1.  The  mean  US  antitank  weapon  assessment  range  for 
trial  201  was  1200i,  computed  from  the  following  assessment  data: 

1  each  M60  pairing  at  1650m 

2  each  DRAGON  pairings  at  700m 

2.  The  same  MOE  for  trial  208  was  1250n,  computed  from 
the  following  data” 


18  M60  pairings  within  1000m 
2  TOW  pairings  at  2700m 


56 


Table  12.  Paired  Firings  Stannary  Statistics 


Player  Group  1 

Player  Group  2 

Mean  %  Paired 

a 

Mean  %  Paired 

SO 

Blue  Firings 

28.6 

15.5 

23.25 

9.3 

Red  Firings 

69.9 

13.7 

64.4 

24.9 

3.  This  was  just  one  example  of  the  Inherent  pitfalls 
In  aggregating  aslessment  range  MOE  across  varying  type  weapon  systems. 
While  the  collective  HOE  was  approximately  the  same  numeric  value  for 
trials  201  and  208,  It  was  obvious  from  Investigating  the  data  by  weapon 
type  that  the  US  force  brought  much  more  firepower  to  bear  on  the  enemy  at 
more  effective  ranges  during  trial  208.  ■ 

(c)  The  MOE  for  percent  of  the  time  (M60/T0W)  spent  In 
overwatch  were  estimated  by  periods  of  nonmovement  for  10  minutes  or 
longer.  During  trails  202  and  203  both  TOWs  were  supporting  from 
overwatch  positions  that  were  approximately  3500m  behind  the  maneuver 
element  and  beyond  their  effective  range  (determined  from  analysis  of 
graphic  display  and  position  location  data).  A  more  valid  measure  of  time 
spent  In  overwatch  Is  needed  for  future  development  of  the  NTC.  Percent 
time  spent  In  overwatch  could  be  estimated  by  periods  of  norunovement  of  10 
minutes  or  longer,  provided  the  weapon  system  was  within  effective  range 
and  had  the  necessary  range  fan  to  properly  support  the  maneuver  elements. 

(d)  While  measures  based  on  number  of  rounds  fired  provide  a 
powerful  diagnostic  tool  In  determining  why  a  unit  performed  as  It  did, 
they  should  not  be  used  as  an  MOE  or  the  units  will  fire  Indiscriminately 
to  Inflate  their  standing. 

(e)  MOE  reflecting  the  effects  of  Indirect  fire  were  based 
solely  on  the  number  of  casualties  Inflicted  on  the  enemy.  No  means  were 
available  to  record  the  effects  of  suppressive  fires. 

1.  FM  71-1  "The  Tank  and  Mechanized  Infantry  Company 
Team"  emphasizes  tTie  use  of  Indirect  fires  to  suppress  and  destroy  the 
enemy,  especially  In  a  movement  to  contact  hasty  attack  scenario. 

2.  CDEC’s  IFCAS  system,  used  during  TIE  to  portray 
Indirect  fire  and  lb  determine  the  resulting  casualty  assessments,  was  the 
most  sophisticated  and  realistic  Indirect  fire  casualty  assessment  and 
suppression  system  available  for  use  In  an  engagement  simulation  exercise. 

3.  During  the  TIE  trials  the  players  who  attempted  to 
employ  Indirect  artillery  fire  as  described  in  FM  71-1  became  increasingly 
frustrated  with  the  lack  of  results  of  their  indirect  fires.  During 
trials  201  through  208  an  average  of  approximately  200  indirect  fires  were 
made  per  trial  with  one  or  two  simulated  batteries  firing  each  mission. 

The  cumulative  casualty  assessments  resulting  from  Indirect  fire  for  the 
eight  trials  were  five  Red  personnel  and  four  Blue  personnel  casualties. 

4.  The  suppression  effects  of  indirect  artillery  fire 
could  not  be  reallJtlcally  portrayed  during  TIE.  During  trial  208  the 
SP6-9  was  able  to  kill  two  M60  tanks  within  minutes  of  receiving 
approximately  50  simulated  155m  artillery  rounds.  These  simulated  rounds 


Impacted  within  25  meters  of  the  hastily  prepared  defense  position 
(determined  from  analysis  of  graphic  display  and  position  location  data). 
The  last  three  volleys  were  within  7  meters  of  the  SP6-9  crew  and  resulted 
In  one  casualty  to  the  crew,  but  no  realistic  effects  of  suppression  were 
Imposed  on  the  remaining  crew  members. 

(f)  MOE  reflecting  the  effective  employment  of  the  US 
Infantry  Indicated  that  Infantry's  contribution  to  the  outcome  of  the 
battle  was  not  very  significant  for  player  group  2. 

1.  During  trials  108  and  110  through  114,  player  set  1 
was  able  to  destroy  the  SPG-9  by  either  a  mounted  or  a  dismounted  Infantry 
attack.  After  losing  an  average  of  two  tanks  per  trial  to  the  SPG-9  for 
the  first  three  trials,  the  unit  commander  tended  to  orient  the  deployment 
of  his  unit  solely  on  attacking  and  destroying  the  SPG-9. 

2.  During  trials  202  and  207  the  mechanized  Infantry 
platoon  led  the  attack,  advanced  too  quickly,  and  was  essentially 
destroyed  while  out  of  range  of  mutual  support  from  the  tank  platoons. 
During  player  set  2  the  DRAGON  killed  a  BMP  In  trial  201  and  a  T62  In 
trial  207.  Other  than  DRAGON  assessments  and  kills,  the  Infantry  did  not 
engage  the  enemy  with  their  organic  weapons. 

3.  The  fact  that  the  Infantry  appeared  to  have  had  a 
minimal  effect  on  Die  outcome  of  TIE  trials,  as  measured  by  the  number  of 
assessments  and/or  kills  attributed  to  the  Infantry,  might  have  been 
driven  by  the  following  factors: 

.  The  unit  leaders,  both  armor  captains,  did  not 

employ  their  Infantry  assets  effectively  during  the 
course  of  the  battle. 

.  The  platoon  leaders,  both  mechanized  Infantry  and 
armor,  had  little  or  no  experience  in  conducting 
combi ned  arms  operations. 

.  The  Instrisoentatlon  and  procedures  used  during  TIE 
did  not  allow  complete  and  effective  participation 
by  the  Infantry  (l.e..  Infantry  players  were 
Instrumented  In  stand-alone  mode,  trials  were 
terminated  before  Infantry  would  engage  In  close  In 
combat). 
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(4)  EEA7.  What  Insights  can  be  gainer4  from  the  TIE  data 
regarding  the  overall  MOE  structure? 

(a)  In  an  attempt  to  gain  Insights  Into  the  total  HOE 
structure  two  types  of  cluster  analysis  were  performed.  The  first 
procedure  clustered  the  MOE  based  on  the  sample  correlations  existing 
among  the  MOEs.  Because  of  the  extremely  small  sample  size  underlying  the 
correlations,  caution  must  be  exercised  when  considering  the  obtained 
results  as  representative.  The  BMDP1M  computer  program  from  the  BMD 
biomedical  statistical  series  (Ref  3)  was  used  as  the  clustering 
procedure.  For  player  set  2  the  MOE  clustered  Into  three  major  groups:  A, 
B,  and  C.  Each  cluster  consisted  of  MOEs  that  displayed  high  to  moderate 
positive  correlations  to  the  other  member  MOE  of  the  cluster.  In  general, 
the  MOE  of  cluster  A  were  not  strongly  correlated  with  the  members  of 
either  cluster  B  or  C.  However,  the  members  of  clusters  B  and  C  tended  to 
display  negative  correlations  to  each  other.  Cluster  membership  of  the 
various  MOEs  is  depicted  In  table  14.  As  Indicated  by  this  table,  several 
of  the  variables  were  transformed  from  their  original  measurement  scale. 
This  was  done  to  reduce  the  skewness  of  the  variables  and  thus  insure 
better  estimate  of  the  Pearson  correlations  between  variables. 
Interestingly,  the  rating  of  tactical  proficiency  and  sequence  of  trial 
both  appeared  In  a  subgroup  of  cluster  C  and  hence  demonstrated  a  similar 
correlational  structure  to  all  other  MOE.  It  should  also  be  noted  that 
the  priority  1  MOEs  tend  to  be  concentrated  in  subclusters  B-l,  B-2,  C-l, 
and  C-2.  Further  Interpretation  of  clusters  and  their  subgroups  appeared 
fruitless  and  was  abandoned.  Because  of  the  aforementioned  data 
collection  problems,  the  correlation  matrix  from  player  set  1  was  expected 
to  be  less  representative  than  that  from  player  set  2.  For  this  reason  no 
attempt  was  made  to  Interpret  these  results  in  a  correlational  cluster 
analysis  similar  to  that  for  player  set  2. 

(b)  The  second  clustering  procedure  attempted  to  identify 
similar  data  patterns  In  the  variables-by-cases  data  matrix.  This 
procedure  inquired  Into  the  sequence  of  trial  structure  as  well  as  the 
structure  of  the  MOE.  Since  learning  was  assumed  to  Increase  from  trial 
to  trial.  It  was  hypothesized  that  clusters  by  trial  sequence  would  occur; 
that  Is,  MOE  data  from  adjacent,  or  near  adjacent,  trials  would  be  more 
similar  than  MOE  data  from  nonadjacent  trials.  Data  from  neither  player 
set  1  or  2  displayed  the  hypothesized  trend.  This  would  seem  to  Indicate 
that:  (1)  the  trial -to- trial  variance  Is  so  great  In  relation  to  the 
accomplished  learning  that  the  learning  effect  Is  not  identifiable,  and/or 
(2)  a  majority  of  the  MOEs  are  not  appropriate  measures  of  the  learning 
occurring.  To  perform  this  analysis  the  BMDP3M  computer  program  of  the 
BMD  biomedical  statistical  series  (Ref  3)  was  used. 
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Table  14.  Cluster  Analysis  for  Player  Set  2 
(Continued  next  page) 


Cluster  A. 


1) 


2.1  Mean  M60  main  gun  assessment  range 

4.2  Number  of  elements  reaching  final  phase  line 

14.1  Range  between  contacting  elements  at  Initial  contact 
2.5  Mean  US  AT  weapon  system  assessment  range 


2) 


2.6  Mean  US  AT  weapon  system  total  kill  range 

14.2  Minimum  range  between  opposing  elements  at  Initial  contact 

10.1  Mean  Percent  of  time  M60  crews  spent  fully  exposed 
*3.1  Percent  of  time  M60  spent  In  overwatch 


3)  a)  2.7  Mean  threat  AT  weapon  assessment  range 
2.8  Mean  threat  AT  weapon  kill  range 
14.4  Mean  range  between  opposing  forces  at  Initial  contact 


b)  5.2  Number  of  threat  AT  rounds 

5.2.1  Number  of  T62  main  gun  rounds 

14.3  Maxlmun  range  between  opposing  forces  at  Initial  contact 

10.3  Mean  percent  of  time  M60  crews  spent  partially  exposed. 


*See  notes  at  end  of  table 


Table  14.  Cluster  Analysis  for  Player  Set  2 
(Continued) 

Cluster  B. 


1)  4.1  Mean  overall  rate  of  advance  to  last  phase  line 

14.5  Range  spread  at  Initial  contact  (Max-Mln) 

*6.2  Ratio  of  MNAT  (US)  to  MNAT  (Threat) 

*77T  Number  of  US  weapon  systems  total  killed 

*77?  Number  of  US  AT  weapons  killed  or  surviving  with  no  anmo 

2)  a)  Transformed  ratio  of  US  to  threat  AT  rounds 

Log  6.6  mean  time  between  US  AT  firings  (min) 

Log  6.7  average  time  between  US  AT  firing  at  each 
surviving  target  (min) 

♦Transformed  7^  effective  exchange  ratio 

b)  *6.1  MNAT  to  US  forces 

*971  Number  of  threat  weapons  not  paired 
♦Transformed  7.3  CER 

♦Transformed  T77l  mean  number  of  M60  main  gun  firings 
before  vulnerable 

Transformed  20.6  number  of  assessments  made  by  threat  INF 
Transformed  6.4  ratio  of  US  AT  assessments  to  MNAT 

3)  Log  10.2  mean  percent  of  M60  crew  In  fully  protected 

position 

13.6  Number  of  IFCAS  made  vs  threat 
13.3  Number  of  IFCAS  made  vs  US  forces 


♦See  notes  at  end  of  table. 


Table  14.  Cluster  Analysis  for  Player  Set  2 
(Concluded) 


Cluster  C. 


1) 


2.3 

5.2.3 
Log  5.1 

*Log  6.3 
Log  5.1.1 
Log  12.4 
*Loq  9.2 

*“TT 


2)  *Loq  6.5 

*  8.1 

* - O 


*Loq  12.2 


4)  5.1.2 
Log  12.3 

5.2.2 

11.2 


5)  2.9 
*3.2 


Mean  TOW  assessment  range 
Nunber  of  SPG-9  rounds  expected 
Number  of  US  AT  rounds  expected 
Ratio  US  AT  firings  to  MNAT 
Number  of  M60  main  gun  rounds  expected 
Mean  number  of  US  AT  rounds  fired  before  vulnerable 
Mean  number  of  US  weapons  pairing  each  threat  target 
Nunber  of  M60  and  TOW  weapons  pairing  at  least  one 
target 

Ratio  of  US  AT  kills  to  MNAT 
Number  of  threat  weapons  killed 
Number  of  threat  AT  weapons  killed  or  surviving 
without  aonunltlon 

Mean  number  of  M60  main  gun  and  secondary  burts 
before  vulnerable 

Rating  of  Tactical  Proficiency 
Trial  Sequence 

Number  of  TOW  rounds  fired 

Mean  number  of  TOW  rounds  fired  before  vulnerable 

Number  of  SAGGER  rounds  fired 

Number  of  threat  weapons  with  aimunltlon  depleted 

Ratio  of  US/threat  AT  weapon  assessment  range 
Percent  of  time  TOW  in  overwatch 


*  indicates  priority  1  MOE  with  tactical  proficiency. 
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(5)  Sumraary/Concluslons  (OBJECTIVE  2). 

(a)  The  majority  of  data  collected  during  TIE  supported 
those  MOE  primarily  related  to  firepower  and  maneuver  (l.e., 
flrlng/palrlng/klll  events  and  movement  rates). 

(b)  The  learning  accomplished  during  a  sequence  of 
force-on-force  Instrumented  exercises  Is  greatly  obscured  by  the 
trial -to- trial  variance  Inherent  In  such  exercises. 

(c)  Those  MOE  depicted  In  tables  7  and  8  were  most 
Indicative  of  the  tactical  proficiency  ratings,  while  those  In  tables 
10  and  11  suggested  that  a  learning  process  had  occurred  across  trial 
sequences. 


(d)  The  large  number  of  unpaired  firings  during 
force-on-force  Instrumented  exercises  poses  a  significant  problem  in 
measuring  mean  assessment/kill  ranges. 

(e)  MOE  that  require  aggregation  of  data  across  varying 
weapon  types  must  be  used  with  extreme  caution. 

(f)  A  more  valid  measure  of  time  spent  in  effective 
overwatch  Is  needed  for  the  future  development  of  the  NTC. 

(g)  A  more  realistic  portrayal  and  valid  MOE  are  needed 
for  the  play  of  indirect  fire,  to  Include  the  effects  of  suppression. 

(h)  The  engagement  simulation  force-on-force  training 
environment  provides  quantifiable  MOE  related  to  areas  of  tactical 
operations  that  have  heretofore  been  evaluated  subjectively,  for 
example: 


TACTICAL  FUNCTION/SKILLS 


MOE 


Locate  and  Effectively  Engage  Enemy  Percent  of  OPFOR  Weapons 

Paired 


Maintain  Mutual  Support/Mass  Superior  Effective  (Blue/Red) 

Combat  Power  Force  Ratio 


Gunner  Accuracy 
Effectiveness  of  Fires 


Percent  of  US  AT  Firings 
Resulting  In  Pairings 

OPFOR  Weapon  Casualties 
per  US  AT  Round  Fired 


Destroy  Enemy  While 

Insuring  Your  Unit's  Survivability 


Casualty  Exchange  Ratio; 
Weapon  Survivability; 
Effective  Exchange  Ratio 


(I)  Those  MOE  In  (h)  above  are  highly  Indicative  of  the 

tactical  proficiency  of  a  unit.  These  NOE  are  also  Interrelated  and  must 
be  looked  at  In  total  to  determine  how  well  the  unit  performed  and  where 
Its  weaknesses  lie.  • 

(J)  NTC  development  must  Include  Instrumentation  and 
procedures  to  realistically  portray  the  infantry  In  their  role  on  the 
modern  battlefield. 

(k)  TIE  was  the  first  attempt  at  Identifing  MOE  related  to 
tactical  proficiency.  Future  testing  should  Investigate  as  many  MOE  as  Is 
feasible,  until  there  Is  a  sufficient  sample  size  to  establish  a  valid  and 
reliable  empirical  data  base. 

(l)  Insufficient  quantitative  data  were  collected  to  derive 
command  and  control  or  Intelligence  type  MOE,  and  resupply/logistics  was 
not  played. 
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NOE  2:  DISTRIBUTION  OF  ENGAGEMENT  RANTES  (METERS) 

Indicates  sample  size  of  1. 

Indicates  sample  size  of  2. 


♦Overwatch  time  estimated  by  periods  of  nonmovement  of  10  minutes  or  longer. 


across  all  vehicle  types. 


HOE  5:  AMMUNITION  EXPENDITURE 


Trial 


MOE  6:  RATIO  OF  TARGETS  ENGAGED  TO  TARGETS  AVAILABLE 
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MOE  7  AND  8:  U.S.  AND  THREAT  CASUALTIES. 


TARGETS  ENf 
I.S.  WEAPON 


HOE  12:  NUMBER  OF  ROUNDS  FIRED  (U.S.)  BEFORE  BECOMING  VULNERABLE* 

"Vulnerable"  &  First  Paired  by  Potentially  Killing  Threat  Antitank  Weapon  (t.e. ,  T62  Main 
Gun,  SAGGER,  SPG-9). 
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MOE  13;  IN01RECT  FIRE  CASUALTY  ASSESSMENT  (KILLS  RECEIVED) 


MOE  14:  RANGE  TO  THREAT  AT  INITIAL  CONTACT  (METERS) 
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APPENDIX  B 
DISTRIBUTION  LTCT 


Organization 

Camander 

se  52c“"ent4t1on  Center 
Cameron  Station 

Alexandria,  Virginia  22314 

Cowander 

USATRAOOC 

ATTN:  ATCD-TH 

ATTN:  ATTNG-PAO-NTC 

Fort  Monroe,  Virginia  23651 

Commander 

USACDEC 

ATTN:  ATEC-SA 

ATTN:  ATEC-EX-TC 

ATTN:  ATEC-Pt 

ATTN:  ATEC-PL-TL 

Fort  Ord,  California  93941 

Cowander 

USATCATA 

ATTN:  ATCAT-TD-TO 
Fort  Hood,  Texas  76544 


Commander 

USACATRADA 

ATTN:  ATZL-TDA-AD 

Fort  Leavenworth,  Kansas  66027 


Science  Applications,  Inc. 

Mr‘  Dunc«n  Hanson 
5959  Gateway  West 
ET  Paso,  Texas  79925 


Dr,  Sam  Parry 
Code  55-Py 

Java!  Postgraduate  School 
Monterey, .  Cal  if  oml  a  93940 


CPT  Tim  Relschl 
SMC  1449 


Java?  Postgraduate  School 
Monterey,  California  93940 


